[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:57:56 dist-test-slave-h3ft krb5kdc[10371](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:57:56 dist-test-slave-h3ft krb5kdc[10371](info): set up 2 sockets
Aug 12 20:57:56 dist-test-slave-h3ft krb5kdc[10371](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 20:57:57.335984 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.389s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:57:57 dist-test-slave-h3ft krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:57:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:57:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:57:57.495059 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35935
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:35935
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:57:57.625151 10392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:57:57.625522 10392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:57:57.625572 10392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:57:57.627151 10392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:57:57.627234 10392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:57:57.627260 10392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:57:57.627283 10392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:57:57.627311 10392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:57:57.629639 10392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:35935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:57:57.630167 10392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:57:57.630537 10392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:57:57.638443 10399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:57.638489 10392 server_base.cc:1034] running on GCE node
W20260812 20:57:57.639106 10403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:57.639338 10400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:57.639750 10392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:57:57.640272 10392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:57:57.641481 10392 hybrid_clock.cc:648] HybridClock initialized: now 1786568277641426 us; error 69 us; skew 500 ppm
Aug 12 20:57:57 dist-test-slave-h3ft krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568277, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:57:57.646248 10392 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:57:57.647220 10392 webserver.cc:460] Webserver started at http://127.10.30.126:39759/ using document root <none> and password file <none>
I20260812 20:57:57.647610 10392 fs_manager.cc:359] Metadata directory not provided
I20260812 20:57:57.647673 10392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:57:57.647859 10392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:57:57.649585 10392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "77dfd1236c38448b888ae561b81e968d"
format_stamp: "Formatted at 2026-08-12 20:57:57 on dist-test-slave-h3ft"
server_key: "0390ae1affcd4a8550eba3066a1178c2"
server_key_iv: "5e0780ca32c9fbff458f9130fd8797da"
server_key_version: "encryptionkey@0"
I20260812 20:57:57.650051 10392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "77dfd1236c38448b888ae561b81e968d"
format_stamp: "Formatted at 2026-08-12 20:57:57 on dist-test-slave-h3ft"
server_key: "0390ae1affcd4a8550eba3066a1178c2"
server_key_iv: "5e0780ca32c9fbff458f9130fd8797da"
server_key_version: "encryptionkey@0"
I20260812 20:57:57.652575 10392 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260812 20:57:57.653952 10412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:57.654326 10392 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:57:57.654430 10392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "77dfd1236c38448b888ae561b81e968d"
format_stamp: "Formatted at 2026-08-12 20:57:57 on dist-test-slave-h3ft"
server_key: "0390ae1affcd4a8550eba3066a1178c2"
server_key_iv: "5e0780ca32c9fbff458f9130fd8797da"
server_key_version: "encryptionkey@0"
I20260812 20:57:57.654525 10392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:57:57.671660 10392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:57:57.675586 10392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:57:57.675803 10392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:57:57.689726 10392 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:35935
I20260812 20:57:57.689908 10501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:35935 every 8 connection(s)
I20260812 20:57:57.690636 10392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:57:57.692824 10502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:57.694221 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10392
I20260812 20:57:57.694386 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:57:57.695391 10361 external_mini_cluster.cc:1428] Setting key 29ba8430d5e760af7ac1892c403b52e8
I20260812 20:57:57.698841 10502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d: Bootstrap starting.
I20260812 20:57:57.700634 10502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:57.701762 10502 log.cc:824] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d: Log is configured to *not* fsync() on all Append() calls
I20260812 20:57:57.703138 10502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d: No bootstrap required, opened a new log
I20260812 20:57:57.707170 10502 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77dfd1236c38448b888ae561b81e968d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35935 } }
I20260812 20:57:57.707410 10502 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:57.707469 10502 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77dfd1236c38448b888ae561b81e968d, State: Initialized, Role: FOLLOWER
I20260812 20:57:57.707665 10502 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77dfd1236c38448b888ae561b81e968d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35935 } }
I20260812 20:57:57.707849 10502 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:57:57.707901 10502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:57:57.707974 10502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:57.709002 10502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77dfd1236c38448b888ae561b81e968d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35935 } }
I20260812 20:57:57.709257 10502 leader_election.cc:302] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77dfd1236c38448b888ae561b81e968d; no voters:
I20260812 20:57:57.709555 10502 leader_election.cc:288] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:57:57.709635 10509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:57:57.709832 10509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [term 1 LEADER]: Becoming Leader. State: Replica: 77dfd1236c38448b888ae561b81e968d, State: Running, Role: LEADER
I20260812 20:57:57.710013 10509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77dfd1236c38448b888ae561b81e968d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35935 } }
I20260812 20:57:57.710228 10502 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:57:57.710784 10510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77dfd1236c38448b888ae561b81e968d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77dfd1236c38448b888ae561b81e968d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35935 } } }
I20260812 20:57:57.710901 10510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [sys.catalog]: This master's current role is: LEADER
I20260812 20:57:57.711163 10512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77dfd1236c38448b888ae561b81e968d. Latest consensus state: current_term: 1 leader_uuid: "77dfd1236c38448b888ae561b81e968d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77dfd1236c38448b888ae561b81e968d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35935 } } }
I20260812 20:57:57.711247 10512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d [sys.catalog]: This master's current role is: LEADER
I20260812 20:57:57.712872 10514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 20:57:57 dist-test-slave-h3ft krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:57:57.714404 10514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:57:57.718113 10514 catalog_manager.cc:1347] Generated new cluster ID: c4d1f60947d34b0ea5c113e075f6156d
I20260812 20:57:57.718184 10514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:57:57.720561 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:57.697018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47602 (local address 127.10.30.126:35935)
0812 20:57:57.697564 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0812 20:57:57.697578 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 20:57:57.697814 (+ 236us) server_negotiation.cc:407] Connection header received
0812 20:57:57.702300 (+ 4486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:57:57.702310 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:57:57.702427 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:57:57.702641 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:57:57.705250 (+ 2609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:57.706573 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:57.708302 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:57.708825 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:57.709008 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:57.715076 (+ 6068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:57:57.715083 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:57:57.715084 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:57:57.715103 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:57:57.717482 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:57.718299 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:57.718317 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:57.718317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:57.718512 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:57.718887 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:57.718888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:57.718888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:57.719376 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:57:57.719660 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0812 20:57:57.720019 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 20:57:57.720238 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":223,"threads_started":1}
I20260812 20:57:57.742039 10514 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:57:57.742833 10514 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:57:57.755231 10514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77dfd1236c38448b888ae561b81e968d: Generated new TSK 0
I20260812 20:57:57.755563 10514 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:57:57.800704 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35935
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:57:57.984400 10541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:57:57.984696 10541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:57:57.984735 10541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:57:57.986421 10541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:57:57.986485 10541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:57:57.986518 10541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:57:57.988579 10541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35935
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:57:57.989043 10541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:57:57.989389 10541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:57:57.997967 10555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:57.998029 10554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:57.998004 10557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:57.998329 10541 server_base.cc:1034] running on GCE node
I20260812 20:57:57.998598 10541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:57:57.998914 10541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:57:58.000255 10541 hybrid_clock.cc:648] HybridClock initialized: now 1786568278000272 us; error 98 us; skew 500 ppm
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:57:58.004468 10541 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:57:58.005208 10541 webserver.cc:460] Webserver started at http://127.10.30.65:37551/ using document root <none> and password file <none>
I20260812 20:57:58.005538 10541 fs_manager.cc:359] Metadata directory not provided
I20260812 20:57:58.005621 10541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:57:58.005787 10541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:57:58.007807 10541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "6fc73ff221694f21bd5dbce7f208c3c6"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "172ef56d6fa823571e9bdb7adffdcbe9"
server_key_iv: "95988365fd9310af3946d6438a45e000"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.008517 10541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "6fc73ff221694f21bd5dbce7f208c3c6"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "172ef56d6fa823571e9bdb7adffdcbe9"
server_key_iv: "95988365fd9310af3946d6438a45e000"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.010808 10541 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 20:57:58.012332 10566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.012638 10541 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:57:58.012781 10541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "6fc73ff221694f21bd5dbce7f208c3c6"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "172ef56d6fa823571e9bdb7adffdcbe9"
server_key_iv: "95988365fd9310af3946d6438a45e000"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.012878 10541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:57:58.036775 10541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:57:58.040297 10541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:57:58.040606 10541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:57:58.041245 10541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:57:58.041833 10541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:57:58.041926 10541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.041965 10541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:57:58.041978 10541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.063234 10541 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:42139
I20260812 20:57:58.063541 10739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:42139 every 8 connection(s)
I20260812 20:57:58.063907 10541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:57:58.072978 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10541
I20260812 20:57:58.073148 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:57:58.073347 10361 external_mini_cluster.cc:1428] Setting key 3d04df474582097d34b1f150f5d7e1c3
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:57:58.080540 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:58.065298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:47505 (local address 127.10.30.126:35935)
0812 20:57:58.065403 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 20:57:58.065407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:57:58.065863 (+ 456us) server_negotiation.cc:407] Connection header received
0812 20:57:58.067091 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:57:58.067094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:57:58.067122 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:57:58.067197 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:57:58.069004 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.069599 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.071205 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.071478 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.071553 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:58.075898 (+ 4345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:57:58.075902 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:57:58.075902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:57:58.075915 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:57:58.078109 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.079134 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.079136 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.079136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.079227 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.079633 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.079635 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.079635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.079801 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:57:58.079862 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 20:57:58.080305 (+ 443us) server_negotiation.cc:299] Negotiation successful
0812 20:57:58.080437 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 20:57:58.080956 10747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:58.065257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:35935 (local address 127.10.30.65:47505)
0812 20:57:58.065654 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 20:57:58.065705 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 20:57:58.066906 (+ 1201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:57:58.067279 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:57:58.067284 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:57:58.068319 (+ 1035us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:57:58.068748 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:57:58.068758 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.069745 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.069746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:57:58.070900 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:57:58.070904 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.071612 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.071613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:57:58.071921 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:58.072781 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:57:58.072796 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:57:58.075749 (+ 2953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:57:58.078228 (+ 2479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:57:58.078245 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:57:58.078249 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:57:58.078813 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:57:58.079315 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:57:58.079316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:57:58.079317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:57:58.079525 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:57:58.079885 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:57:58.079895 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:57:58.080134 (+ 239us) client_negotiation.cc:769] Sending connection context
0812 20:57:58.080268 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 20:57:58.080517 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":202,"threads_started":1}
I20260812 20:57:58.081844 10741 heartbeater.cc:347] Connected to a master server at 127.10.30.126:35935
I20260812 20:57:58.082002 10741 heartbeater.cc:464] Registering TS with master...
I20260812 20:57:58.082279 10741 heartbeater.cc:511] Master 127.10.30.126:35935 requested a full tablet report, sending...
I20260812 20:57:58.083511 10438 ts_manager.cc:194] Registered new tserver with Master: 6fc73ff221694f21bd5dbce7f208c3c6 (127.10.30.65:42139)
I20260812 20:57:58.084367 10438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:47505
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:57:58.115692 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35935
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:57:58.256115 10752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:57:58.256417 10752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:57:58.256467 10752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:57:58.258018 10752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:57:58.258085 10752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:57:58.258140 10752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:57:58.260149 10752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35935
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:57:58.260491 10752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:57:58.260788 10752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:57:58.268657 10763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:58.268558 10761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:58.268669 10760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:58.269574 10752 server_base.cc:1034] running on GCE node
I20260812 20:57:58.269838 10752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:57:58.270149 10752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:57:58.271315 10752 hybrid_clock.cc:648] HybridClock initialized: now 1786568278271289 us; error 48 us; skew 500 ppm
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:57:58.275228 10752 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:57:58.275735 10752 webserver.cc:460] Webserver started at http://127.10.30.66:37011/ using document root <none> and password file <none>
I20260812 20:57:58.275993 10752 fs_manager.cc:359] Metadata directory not provided
I20260812 20:57:58.276042 10752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:57:58.276150 10752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:57:58.277428 10752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "8a680af46320409eb66230bb357e8aa3"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "9727ab2ac5aff344e433d4f3d6c3374e"
server_key_iv: "8e83fa26da707d82fca12743b20d186d"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.277791 10752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "8a680af46320409eb66230bb357e8aa3"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "9727ab2ac5aff344e433d4f3d6c3374e"
server_key_iv: "8e83fa26da707d82fca12743b20d186d"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.279709 10752 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 20:57:58.280815 10779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.281033 10752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:57:58.281142 10752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "8a680af46320409eb66230bb357e8aa3"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "9727ab2ac5aff344e433d4f3d6c3374e"
server_key_iv: "8e83fa26da707d82fca12743b20d186d"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.281216 10752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:57:58.313230 10752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:57:58.316655 10752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:57:58.316879 10752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:57:58.317387 10752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:57:58.317962 10752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:57:58.318002 10752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.318063 10752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:57:58.318095 10752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.337613 10752 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:39901
I20260812 20:57:58.337797 10968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:39901 every 8 connection(s)
I20260812 20:57:58.338084 10752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:57:58.345541 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10752
I20260812 20:57:58.345674 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:57:58.345868 10361 external_mini_cluster.cc:1428] Setting key bd0d8100ef85d96ece19fed9fce91d64
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:57:58.351202 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:58.339189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:38621 (local address 127.10.30.126:35935)
0812 20:57:58.339277 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 20:57:58.339279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:57:58.339722 (+ 443us) server_negotiation.cc:407] Connection header received
0812 20:57:58.340639 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:57:58.340640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:57:58.340655 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:57:58.340724 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:57:58.342179 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.342760 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.344144 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.344358 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.344423 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:58.347774 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:57:58.347776 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:57:58.347776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:57:58.347788 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:57:58.349456 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.349972 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.349974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.349975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.350053 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.350359 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.350360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.350360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.350510 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:57:58.350592 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 20:57:58.350933 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 20:57:58.351087 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 20:57:58.351565 10971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:58.339216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:35935 (local address 127.10.30.66:38621)
0812 20:57:58.339537 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 20:57:58.339586 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 20:57:58.340505 (+ 919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:57:58.340821 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:57:58.340825 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:57:58.341673 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:57:58.342067 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:57:58.342075 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.342858 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.342859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:57:58.344046 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:57:58.344049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.344442 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.344443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:57:58.344631 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:58.345471 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:57:58.345486 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:57:58.347659 (+ 2173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:57:58.349580 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:57:58.349592 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:57:58.349596 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:57:58.349887 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:57:58.350128 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:57:58.350129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:57:58.350130 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:57:58.350281 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:57:58.350580 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:57:58.350589 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:57:58.350776 (+ 187us) client_negotiation.cc:769] Sending connection context
0812 20:57:58.350899 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 20:57:58.351144 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":183,"threads_started":1}
I20260812 20:57:58.352247 10969 heartbeater.cc:347] Connected to a master server at 127.10.30.126:35935
I20260812 20:57:58.352391 10969 heartbeater.cc:464] Registering TS with master...
I20260812 20:57:58.352698 10969 heartbeater.cc:511] Master 127.10.30.126:35935 requested a full tablet report, sending...
I20260812 20:57:58.353258 10438 ts_manager.cc:194] Registered new tserver with Master: 8a680af46320409eb66230bb357e8aa3 (127.10.30.66:39901)
I20260812 20:57:58.353721 10438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:38621
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:57:58.386140 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35935
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:57:58.535507 10975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:57:58.535809 10975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:57:58.535846 10975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:57:58.537340 10975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:57:58.537386 10975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:57:58.537420 10975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:57:58.539471 10975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35935
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:57:58.539733 10975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:57:58.539989 10975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:57:58.548082 10987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:58.548163 10984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:58.548174 10985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:58.548403 10975 server_base.cc:1034] running on GCE node
I20260812 20:57:58.548651 10975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:57:58.548972 10975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:57:58.550233 10975 hybrid_clock.cc:648] HybridClock initialized: now 1786568278550209 us; error 39 us; skew 500 ppm
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:57:58.554242 10975 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:57:58.554855 10975 webserver.cc:460] Webserver started at http://127.10.30.67:37543/ using document root <none> and password file <none>
I20260812 20:57:58.555166 10975 fs_manager.cc:359] Metadata directory not provided
I20260812 20:57:58.555223 10975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:57:58.555418 10975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:57:58.556951 10975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "e86afc13806d4525b02c3a75f4a24891"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "d1317300b03637a765ea8cf49780fd89"
server_key_iv: "0d51ff16b245bfc52af6c55cc8045a5c"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.557480 10975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "e86afc13806d4525b02c3a75f4a24891"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "d1317300b03637a765ea8cf49780fd89"
server_key_iv: "0d51ff16b245bfc52af6c55cc8045a5c"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.559664 10975 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:57:58.561036 10999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.561298 10975 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:57:58.561427 10975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "e86afc13806d4525b02c3a75f4a24891"
format_stamp: "Formatted at 2026-08-12 20:57:58 on dist-test-slave-h3ft"
server_key: "d1317300b03637a765ea8cf49780fd89"
server_key_iv: "0d51ff16b245bfc52af6c55cc8045a5c"
server_key_version: "encryptionkey@0"
I20260812 20:57:58.561527 10975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:57:58.577819 10975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:57:58.580585 10975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:57:58.580828 10975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:57:58.581284 10975 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:57:58.581733 10975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:57:58.581792 10975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.581833 10975 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:57:58.581876 10975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:58.600172 10975 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:41609
I20260812 20:57:58.600407 11190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:41609 every 8 connection(s)
I20260812 20:57:58.600760 10975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:57:58.606350 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10975
I20260812 20:57:58.606475 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:57:58.606681 10361 external_mini_cluster.cc:1428] Setting key fb1b592a9a1c1d8d4fc0a6debdaad7a3
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:57:58.613503 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:58.601860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:54981 (local address 127.10.30.126:35935)
0812 20:57:58.601934 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 20:57:58.601936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:57:58.602417 (+ 481us) server_negotiation.cc:407] Connection header received
0812 20:57:58.603325 (+ 908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:57:58.603327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:57:58.603340 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:57:58.603410 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:57:58.604777 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.605363 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.606699 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.606991 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.607138 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:58.610371 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:57:58.610372 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:57:58.610373 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:57:58.610381 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:57:58.612044 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.612444 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.612445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.612446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.612536 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.612772 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.612772 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.612773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.612900 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:57:58.613012 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 20:57:58.613337 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 20:57:58.613418 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 20:57:58.613942 11196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:58.601830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:35935 (local address 127.10.30.67:54981)
0812 20:57:58.602210 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0812 20:57:58.602264 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 20:57:58.603199 (+ 935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:57:58.603486 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:57:58.603490 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:57:58.604336 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:57:58.604654 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:57:58.604661 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.605460 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.605461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:57:58.606599 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:57:58.606602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.607149 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.607151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:57:58.607401 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:58.608270 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:57:58.608283 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:57:58.610259 (+ 1976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:57:58.612111 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:57:58.612119 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:57:58.612121 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:57:58.612374 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:57:58.612601 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:57:58.612601 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:57:58.612602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:57:58.612716 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:57:58.613014 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:57:58.613023 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:57:58.613212 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 20:57:58.613327 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 20:57:58.613508 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":227,"threads_started":1}
I20260812 20:57:58.614596 11192 heartbeater.cc:347] Connected to a master server at 127.10.30.126:35935
I20260812 20:57:58.614730 11192 heartbeater.cc:464] Registering TS with master...
I20260812 20:57:58.614957 11192 heartbeater.cc:511] Master 127.10.30.126:35935 requested a full tablet report, sending...
I20260812 20:57:58.615494 10438 ts_manager.cc:194] Registered new tserver with Master: e86afc13806d4525b02c3a75f4a24891 (127.10.30.67:41609)
I20260812 20:57:58.615943 10438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:54981
I20260812 20:57:58.619185 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:57:58.652853 11202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:58.641879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39604 (local address 127.10.30.65:42139)
0812 20:57:58.642116 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 20:57:58.642151 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0812 20:57:58.642173 (+ 22us) server_negotiation.cc:407] Connection header received
0812 20:57:58.642291 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:57:58.642294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:57:58.642328 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:57:58.642404 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:57:58.643424 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.644468 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.645471 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.645946 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.646035 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:58.649227 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:57:58.649242 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:57:58.649242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:57:58.649252 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:57:58.651449 (+ 2197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.651854 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.651858 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.651859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.651931 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.652186 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.652187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.652187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.652370 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:57:58.652523 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 20:57:58.652625 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 20:57:58.652707 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":141,"threads_started":1}
W20260812 20:57:58.653556 10607 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39604
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:57:58.685814 11202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:57:58.676419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39620 (local address 127.10.30.65:42139)
0812 20:57:58.676537 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 20:57:58.676540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:57:58.676680 (+ 140us) server_negotiation.cc:407] Connection header received
0812 20:57:58.676724 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:57:58.676726 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:57:58.676747 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:57:58.676826 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:57:58.677645 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.678265 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.679302 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:57:58.679552 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:57:58.679634 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:57:58.682448 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:57:58.682449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:57:58.682450 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:57:58.682459 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:57:58.684153 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.684573 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.684574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.684575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.684645 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:57:58.685075 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:57:58.685077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:57:58.685077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:57:58.685247 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:57:58.685366 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 20:57:58.685504 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 20:57:58.685658 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 20:57:58.686595 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10541
I20260812 20:57:58.708953 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10752
I20260812 20:57:58.733385 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10975
I20260812 20:57:58.744779 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10392
2026-08-12T20:57:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2843 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[11212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[11212](info): set up 2 sockets
Aug 12 20:57:58 dist-test-slave-h3ft krb5kdc[11212](info): commencing operation
krb5kdc: starting...
W20260812 20:58:00.139528 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.357s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:00 dist-test-slave-h3ft krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:00.299479 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43367
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:43367
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:00.404510 11239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:00.404868 11239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:00.404915 11239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:00.406349 11239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:00.406451 11239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:00.406477 11239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:00.406498 11239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:00.406525 11239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:00.408476 11239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:43367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:00.408854 11239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:00.409157 11239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:00.415555 11253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:00.415544 11248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:00.415560 11250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:00.415944 11239 server_base.cc:1034] running on GCE node
I20260812 20:58:00.416281 11239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:00.416638 11239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:00.417829 11239 hybrid_clock.cc:648] HybridClock initialized: now 1786568280417814 us; error 45 us; skew 500 ppm
Aug 12 20:58:00 dist-test-slave-h3ft krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568280, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:00.421188 11239 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:00.421761 11239 webserver.cc:460] Webserver started at http://127.10.30.126:44031/ using document root <none> and password file <none>
I20260812 20:58:00.422035 11239 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:00.422109 11239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:00.422281 11239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:00.423642 11239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "af97682e8e6c4f08bffbd56b3ba22426"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "b81be85bfdef0730b6892483ad5b5982"
server_key_iv: "af059c2510e8e3a96f9fa4a794774851"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.424089 11239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "af97682e8e6c4f08bffbd56b3ba22426"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "b81be85bfdef0730b6892483ad5b5982"
server_key_iv: "af059c2510e8e3a96f9fa4a794774851"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.425765 11239 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:00.426784 11268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:00.427134 11239 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:00.427266 11239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "af97682e8e6c4f08bffbd56b3ba22426"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "b81be85bfdef0730b6892483ad5b5982"
server_key_iv: "af059c2510e8e3a96f9fa4a794774851"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.427367 11239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:00.439895 11239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:00.442986 11239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:00.443267 11239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:00.448346 11239 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:43367
I20260812 20:58:00.448383 11351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:43367 every 8 connection(s)
I20260812 20:58:00.448843 11239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:00.450090 11352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:00.453080 11352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426: Bootstrap starting.
I20260812 20:58:00.453882 11352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:00.454244 11352 log.cc:824] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:00.455206 11352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426: No bootstrap required, opened a new log
I20260812 20:58:00.457100 11352 raft_consensus.cc:348] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af97682e8e6c4f08bffbd56b3ba22426" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43367 } }
I20260812 20:58:00.457270 11352 raft_consensus.cc:374] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:00.457296 11352 raft_consensus.cc:729] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af97682e8e6c4f08bffbd56b3ba22426, State: Initialized, Role: FOLLOWER
I20260812 20:58:00.457508 11352 consensus_queue.cc:260] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af97682e8e6c4f08bffbd56b3ba22426" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43367 } }
I20260812 20:58:00.457584 11352 raft_consensus.cc:388] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:00.457609 11352 raft_consensus.cc:482] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:00.457680 11352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:00.458089 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 11239
I20260812 20:58:00.458189 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:00.458393 11352 raft_consensus.cc:504] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af97682e8e6c4f08bffbd56b3ba22426" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43367 } }
I20260812 20:58:00.458431 10361 external_mini_cluster.cc:1428] Setting key 9231c271d7c52d1a9ca30ea9877173a8
I20260812 20:58:00.458542 11352 leader_election.cc:302] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af97682e8e6c4f08bffbd56b3ba22426; no voters:
I20260812 20:58:00.458765 11352 leader_election.cc:288] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:00.458802 11357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:00.459051 11357 raft_consensus.cc:686] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [term 1 LEADER]: Becoming Leader. State: Replica: af97682e8e6c4f08bffbd56b3ba22426, State: Running, Role: LEADER
I20260812 20:58:00.459220 11357 consensus_queue.cc:237] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af97682e8e6c4f08bffbd56b3ba22426" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43367 } }
I20260812 20:58:00.459403 11352 sys_catalog.cc:564] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:00.459934 11358 sys_catalog.cc:455] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af97682e8e6c4f08bffbd56b3ba22426" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af97682e8e6c4f08bffbd56b3ba22426" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43367 } } }
I20260812 20:58:00.460107 11359 sys_catalog.cc:455] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af97682e8e6c4f08bffbd56b3ba22426. Latest consensus state: current_term: 1 leader_uuid: "af97682e8e6c4f08bffbd56b3ba22426" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af97682e8e6c4f08bffbd56b3ba22426" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43367 } } }
I20260812 20:58:00.460119 11358 sys_catalog.cc:458] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:00.460227 11359 sys_catalog.cc:458] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:00.460554 11381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:00.461563 11381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:00.463435 11381 catalog_manager.cc:1347] Generated new cluster ID: f1714811bcb24797964a001c83cb88f3
I20260812 20:58:00.463497 11381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 20:58:00 dist-test-slave-h3ft krb5kdc[11212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:00.472275 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:00.459152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35958 (local address 127.10.30.126:43367)
0812 20:58:00.459433 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:00.459461 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:00.459505 (+ 44us) server_negotiation.cc:407] Connection header received
0812 20:58:00.459664 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:00.459674 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:00.459749 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:00.459966 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:00.461153 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.462572 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.463711 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.464365 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.464478 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:00.467814 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:00.467820 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:00.467820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:00.467838 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:00.470235 (+ 2397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:00.470689 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:00.470694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:00.470695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:00.470880 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:00.471129 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:00.471130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:00.471131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:00.471534 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:00.471729 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:00.471820 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 20:58:00.471989 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
I20260812 20:58:00.487785 11381 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:00.488525 11381 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:00.493628 11381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af97682e8e6c4f08bffbd56b3ba22426: Generated new TSK 0
I20260812 20:58:00.493906 11381 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:00.527603 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43367
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:00.627170 11403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:00.627446 11403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:00.627478 11403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:00.628723 11403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:00.628763 11403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:00.628793 11403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:00.630468 11403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43367
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:00.630795 11403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:00.631165 11403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:00.637588 11424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:00.637633 11403 server_base.cc:1034] running on GCE node
W20260812 20:58:00.637598 11419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:00.637633 11420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:00.638149 11403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:00.638499 11403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:00.639695 11403 hybrid_clock.cc:648] HybridClock initialized: now 1786568280639686 us; error 39 us; skew 500 ppm
Aug 12 20:58:00 dist-test-slave-h3ft krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568280, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:00.643204 11403 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:00.643798 11403 webserver.cc:460] Webserver started at http://127.10.30.65:46399/ using document root <none> and password file <none>
I20260812 20:58:00.644093 11403 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:00.644166 11403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:00.644333 11403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:00.645730 11403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "b3f0e06506b04fb5809bd29ea68709f5"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "d08f500d7ccfa5190b8bd9ddbdfcbf10"
server_key_iv: "6228ed7ba35a465f6ea6d192effc6c7d"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.646175 11403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "b3f0e06506b04fb5809bd29ea68709f5"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "d08f500d7ccfa5190b8bd9ddbdfcbf10"
server_key_iv: "6228ed7ba35a465f6ea6d192effc6c7d"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.647969 11403 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 20:58:00.648931 11435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:00.649187 11403 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:00.649317 11403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "b3f0e06506b04fb5809bd29ea68709f5"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "d08f500d7ccfa5190b8bd9ddbdfcbf10"
server_key_iv: "6228ed7ba35a465f6ea6d192effc6c7d"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.649403 11403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:00.673883 11403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:00.677104 11403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:00.677333 11403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:00.677670 11403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:00.678097 11403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:00.678169 11403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:00.678218 11403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:00.678256 11403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:00.687080 11403 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:34405
I20260812 20:58:00.687161 11623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:34405 every 8 connection(s)
I20260812 20:58:00.687572 11403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
Aug 12 20:58:00 dist-test-slave-h3ft krb5kdc[11212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568280, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:00.695854 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 11403
I20260812 20:58:00.696045 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:00.696269 10361 external_mini_cluster.cc:1428] Setting key faa57a2756e58f3321a1f3f797d6953a
I20260812 20:58:00.700227 11626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:00.688487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43367 (local address 127.10.30.65:56721)
0812 20:58:00.688708 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:00.688756 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:00.690102 (+ 1346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:00.690468 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:00.690472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:00.690836 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:00.691143 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:00.691149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.692010 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.692011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:00.692986 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:00.692988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.693465 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.693466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:00.693630 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:00.694354 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:00.694365 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:00.696356 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:00.698293 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:00.698307 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:00.698310 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:00.698726 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:00.698954 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:00.698955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:00.698955 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:00.699173 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:00.699533 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:00.699542 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:00.699716 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 20:58:00.699816 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 20:58:00.699993 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":112,"threads_started":1}
I20260812 20:58:00.700230 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:00.688521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:56721 (local address 127.10.30.126:43367)
0812 20:58:00.688605 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:00.688607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:00.688876 (+ 269us) server_negotiation.cc:407] Connection header received
0812 20:58:00.690280 (+ 1404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:00.690282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:00.690302 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:00.690361 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:00.691273 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.691871 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.693109 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.693347 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.693441 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:00.696502 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:00.696504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:00.696505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:00.696516 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:00.698189 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:00.698809 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:00.698810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:00.698810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:00.698878 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:00.699270 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:00.699271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:00.699272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:00.699446 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:00.699529 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:00.699949 (+ 420us) server_negotiation.cc:299] Negotiation successful
0812 20:58:00.700078 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 20:58:00.700899 11624 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43367
I20260812 20:58:00.701052 11624 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:00.701300 11624 heartbeater.cc:511] Master 127.10.30.126:43367 requested a full tablet report, sending...
I20260812 20:58:00.702032 11291 ts_manager.cc:194] Registered new tserver with Master: b3f0e06506b04fb5809bd29ea68709f5 (127.10.30.65:34405)
I20260812 20:58:00.702734 11291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:56721
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:00.731740 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43367
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:00.836572 11632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:00.836839 11632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:00.836869 11632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:00.838231 11632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:00.838292 11632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:00.838325 11632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:00.840396 11632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43367
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:00.840646 11632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:00.840878 11632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:00.848805 11641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:00.848805 11639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:00.848814 11648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:00.849871 11632 server_base.cc:1034] running on GCE node
I20260812 20:58:00.850199 11632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:00.850653 11632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:00.851832 11632 hybrid_clock.cc:648] HybridClock initialized: now 1786568280851802 us; error 44 us; skew 500 ppm
Aug 12 20:58:00 dist-test-slave-h3ft krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568280, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:00.855685 11632 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:00.856609 11632 webserver.cc:460] Webserver started at http://127.10.30.66:46795/ using document root <none> and password file <none>
I20260812 20:58:00.856931 11632 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:00.856992 11632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:00.857168 11632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:00.858551 11632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "5f2d9b7fb4134361a324c5f70671eb27"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "5933f7e55cc6709faaad926a207f0fe9"
server_key_iv: "04646a524796d2dc3c3f37bd6bbcf194"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.859056 11632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "5f2d9b7fb4134361a324c5f70671eb27"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "5933f7e55cc6709faaad926a207f0fe9"
server_key_iv: "04646a524796d2dc3c3f37bd6bbcf194"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.860831 11632 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260812 20:58:00.861860 11655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:00.862100 11632 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:00.862216 11632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "5f2d9b7fb4134361a324c5f70671eb27"
format_stamp: "Formatted at 2026-08-12 20:58:00 on dist-test-slave-h3ft"
server_key: "5933f7e55cc6709faaad926a207f0fe9"
server_key_iv: "04646a524796d2dc3c3f37bd6bbcf194"
server_key_version: "encryptionkey@0"
I20260812 20:58:00.862298 11632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:00.888028 11632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:00.891137 11632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:00.891322 11632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:00.891710 11632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:00.892146 11632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:00.892207 11632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:00.892258 11632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:00.892302 11632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:00.899755 11632 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:35561
I20260812 20:58:00.899849 11833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:35561 every 8 connection(s)
I20260812 20:58:00.900256 11632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:00.901178 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 11632
I20260812 20:58:00.901281 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:00.901531 10361 external_mini_cluster.cc:1428] Setting key 7319ddcf76ec5ab58087b8400a5525c3
Aug 12 20:58:00 dist-test-slave-h3ft krb5kdc[11212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568280, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:00.914685 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:00.901605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:47349 (local address 127.10.30.126:43367)
0812 20:58:00.901674 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:00.901677 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:00.901899 (+ 222us) server_negotiation.cc:407] Connection header received
0812 20:58:00.903523 (+ 1624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:00.903524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:00.903548 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:00.903605 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:00.904727 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.905409 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.906957 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.907282 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.907371 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:00.910828 (+ 3457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:00.910829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:00.910830 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:00.910839 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:00.912575 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:00.913213 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:00.913214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:00.913215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:00.913308 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:00.913713 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:00.913715 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:00.913715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:00.913880 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:00.913959 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:00.914457 (+ 498us) server_negotiation.cc:299] Negotiation successful
0812 20:58:00.914580 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
I20260812 20:58:00.914953 11838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:00.901428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43367 (local address 127.10.30.66:47349)
0812 20:58:00.901715 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:00.901776 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:00.903351 (+ 1575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:00.903720 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:00.903726 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:00.904220 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:00.904597 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:00.904604 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.905568 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.905570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:00.906800 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:00.906804 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:00.907399 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:00.907400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:00.907592 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:00.908388 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:00.908404 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:00.910687 (+ 2283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:00.912683 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:00.912695 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:00.912698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:00.913107 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:00.913395 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:00.913396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:00.913397 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:00.913576 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:00.913975 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:00.913985 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:00.914222 (+ 237us) client_negotiation.cc:769] Sending connection context
0812 20:58:00.914373 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 20:58:00.914601 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":120,"threads_started":1}
I20260812 20:58:00.915678 11836 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43367
I20260812 20:58:00.915818 11836 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:00.916074 11836 heartbeater.cc:511] Master 127.10.30.126:43367 requested a full tablet report, sending...
I20260812 20:58:00.916617 11291 ts_manager.cc:194] Registered new tserver with Master: 5f2d9b7fb4134361a324c5f70671eb27 (127.10.30.66:35561)
I20260812 20:58:00.917076 11291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:47349
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:00.939504 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43367
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:01.042907 11842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:01.043330 11842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:01.043367 11842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:01.044785 11842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:01.044842 11842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:01.044872 11842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:01.046681 11842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43367
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:01.047060 11842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:01.047371 11842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:01.053921 11849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:01.053900 11848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:01.053900 11851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:01.054455 11842 server_base.cc:1034] running on GCE node
I20260812 20:58:01.054788 11842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:01.055156 11842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:01.056344 11842 hybrid_clock.cc:648] HybridClock initialized: now 1786568281056320 us; error 48 us; skew 500 ppm
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568281, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:01.064952 11842 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:01.065557 11842 webserver.cc:460] Webserver started at http://127.10.30.67:39275/ using document root <none> and password file <none>
I20260812 20:58:01.065903 11842 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:01.065959 11842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:01.066119 11842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:01.067684 11842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "be60df0cfc90416e9da67d5bd799df74"
format_stamp: "Formatted at 2026-08-12 20:58:01 on dist-test-slave-h3ft"
server_key: "e6c14fa2b6489c11c5fb70812e16b14d"
server_key_iv: "6af12902e1c96c8254306165eac3861f"
server_key_version: "encryptionkey@0"
I20260812 20:58:01.068114 11842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "be60df0cfc90416e9da67d5bd799df74"
format_stamp: "Formatted at 2026-08-12 20:58:01 on dist-test-slave-h3ft"
server_key: "e6c14fa2b6489c11c5fb70812e16b14d"
server_key_iv: "6af12902e1c96c8254306165eac3861f"
server_key_version: "encryptionkey@0"
I20260812 20:58:01.069969 11842 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:01.071245 11861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:01.071486 11842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:01.071587 11842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "be60df0cfc90416e9da67d5bd799df74"
format_stamp: "Formatted at 2026-08-12 20:58:01 on dist-test-slave-h3ft"
server_key: "e6c14fa2b6489c11c5fb70812e16b14d"
server_key_iv: "6af12902e1c96c8254306165eac3861f"
server_key_version: "encryptionkey@0"
I20260812 20:58:01.071664 11842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:01.086658 11842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:01.089632 11842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:01.089790 11842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:01.090049 11842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:01.090490 11842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:01.090543 11842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:01.090572 11842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:01.090622 11842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:01.098749 11842 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:42043
I20260812 20:58:01.098801 12041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:42043 every 8 connection(s)
I20260812 20:58:01.099354 11842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:01.107725 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 11842
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[11212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568281, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:01.107833 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:01.108043 10361 external_mini_cluster.cc:1428] Setting key cceb65889c62b63befd15aab043c9b67
I20260812 20:58:01.112479 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.100430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:35145 (local address 127.10.30.126:43367)
0812 20:58:01.100513 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.100515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.100809 (+ 294us) server_negotiation.cc:407] Connection header received
0812 20:58:01.102017 (+ 1208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.102019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.102036 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.102095 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:01.102899 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.103580 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.104823 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.105092 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.105173 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.108630 (+ 3457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:01.108633 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:01.108633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:01.108644 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:01.110588 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.111220 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.111222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.111223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.111296 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.111618 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.111619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.111620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.111782 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:01.111871 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.112227 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.112355 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 20:58:01.112790 12046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.100438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43367 (local address 127.10.30.67:35145)
0812 20:58:01.100654 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:01.100703 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:01.101855 (+ 1152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:01.102171 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:01.102176 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:01.102533 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:01.102789 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.102794 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.103706 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.103708 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.104713 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.104717 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.105353 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.105355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.105518 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.106295 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:01.106307 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:01.108502 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:01.110711 (+ 2209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:01.110724 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:01.110728 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:01.111133 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:01.111374 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:01.111376 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:01.111376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:01.111535 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:01.111856 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:01.111866 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:01.112064 (+ 198us) client_negotiation.cc:769] Sending connection context
0812 20:58:01.112203 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 20:58:01.112448 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":108,"threads_started":1}
I20260812 20:58:01.113586 12044 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43367
I20260812 20:58:01.113727 12044 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:01.114005 12044 heartbeater.cc:511] Master 127.10.30.126:43367 requested a full tablet report, sending...
I20260812 20:58:01.114554 11291 ts_manager.cc:194] Registered new tserver with Master: be60df0cfc90416e9da67d5bd799df74 (127.10.30.67:42043)
I20260812 20:58:01.115090 11291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:35145
I20260812 20:58:01.120626 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:58:01.131481 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.123257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35960 (local address 127.10.30.126:43367)
0812 20:58:01.123372 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.123376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.123493 (+ 117us) server_negotiation.cc:407] Connection header received
0812 20:58:01.123607 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.123608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.123623 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.123704 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:01.124563 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.125176 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.126122 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.126371 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.126481 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.128181 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:01.128183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:01.128183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:01.128195 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:01.129869 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.130370 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.130371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.130372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.130448 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.130675 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.130676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.130676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.130890 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:01.131044 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.131245 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.131353 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 20:58:01.135314 11291 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35960:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:01.137575 11291 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:01.146733 12056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.141747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35561 (local address 127.0.0.1:40952)
0812 20:58:01.142034 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:01.142100 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:01.142190 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:01.142650 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:01.142654 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:01.142657 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:01.142773 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.142775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.144007 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.144009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.145112 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.145115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.146308 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.146310 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.146411 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.146429 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 20:58:01.146518 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 20:58:01.146602 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":119,"threads_started":1}
I20260812 20:58:01.147068 12057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.141747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:34405 (local address 127.0.0.1:55318)
0812 20:58:01.142504 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:01.142518 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:01.142592 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:01.143093 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:01.143095 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:01.143098 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:01.143170 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.143173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.144944 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.144946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.145859 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.145862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.146787 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.146788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.146859 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.146865 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 20:58:01.146900 (+ 35us) client_negotiation.cc:240] Negotiation successful
0812 20:58:01.146957 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":5,"thread_start_us":126,"threads_started":1}
I20260812 20:58:01.146745 12058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.142043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40952 (local address 127.10.30.66:35561)
0812 20:58:01.142308 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.142313 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.142324 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:01.142381 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.142382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.142397 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.142516 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:01.142965 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.143869 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.145243 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.146209 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.146300 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.146376 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.146560 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.146631 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":112,"threads_started":1}
I20260812 20:58:01.147583 12061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.142020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55318 (local address 127.10.30.65:34405)
0812 20:58:01.142779 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.142784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.142797 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:01.142885 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.142887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.142906 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.143282 (+ 376us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:01.143460 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.144793 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.145960 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.146683 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.147229 (+ 546us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.147328 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.147357 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.147458 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":257,"threads_started":1}
I20260812 20:58:01.148414 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.142090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42043 (local address 127.0.0.1:55790)
0812 20:58:01.142504 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:01.142518 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:01.142592 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:01.143124 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:01.143125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:01.143126 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:01.143221 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.143223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.145191 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.145193 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.146513 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.146517 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.148016 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.148018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.148171 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.148178 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 20:58:01.148245 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 20:58:01.148326 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":184,"threads_started":1}
I20260812 20:58:01.148465 12062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.142488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55790 (local address 127.10.30.67:42043)
0812 20:58:01.142851 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.142855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.142865 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:01.142962 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.142965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.142982 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.143313 (+ 331us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:01.143578 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.144906 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.146624 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.147903 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.147995 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.148072 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.148294 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.148352 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":117,"threads_started":1}
I20260812 20:58:01.148705 11725 tablet_service.cc:1467] Processing CreateTablet for tablet 6d49c88f9b5647e5ab919bbbe9e5e198 (DEFAULT_TABLE table=test-table [id=0f5d621eef384b5b8b3a24eec2970a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:01.148873 11515 tablet_service.cc:1467] Processing CreateTablet for tablet 6d49c88f9b5647e5ab919bbbe9e5e198 (DEFAULT_TABLE table=test-table [id=0f5d621eef384b5b8b3a24eec2970a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:01.149510 11725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d49c88f9b5647e5ab919bbbe9e5e198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:01.149616 11515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d49c88f9b5647e5ab919bbbe9e5e198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:01.150000 11947 tablet_service.cc:1467] Processing CreateTablet for tablet 6d49c88f9b5647e5ab919bbbe9e5e198 (DEFAULT_TABLE table=test-table [id=0f5d621eef384b5b8b3a24eec2970a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:01.150569 11947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d49c88f9b5647e5ab919bbbe9e5e198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:01.154001 12063 tablet_bootstrap.cc:492] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27: Bootstrap starting.
I20260812 20:58:01.155035 12064 tablet_bootstrap.cc:492] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5: Bootstrap starting.
I20260812 20:58:01.155678 12063 tablet_bootstrap.cc:654] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:01.155761 12065 tablet_bootstrap.cc:492] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74: Bootstrap starting.
I20260812 20:58:01.155882 12064 tablet_bootstrap.cc:654] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:01.156644 12065 tablet_bootstrap.cc:654] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:01.156991 12064 log.cc:824] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:01.157202 12065 log.cc:824] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:01.157931 12064 tablet_bootstrap.cc:492] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5: No bootstrap required, opened a new log
I20260812 20:58:01.158043 12064 ts_tablet_manager.cc:1397] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:58:01.158282 12065 tablet_bootstrap.cc:492] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74: No bootstrap required, opened a new log
I20260812 20:58:01.158388 12065 ts_tablet_manager.cc:1397] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:58:01.158432 12063 log.cc:824] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:01.159780 12063 tablet_bootstrap.cc:492] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27: No bootstrap required, opened a new log
I20260812 20:58:01.159873 12063 ts_tablet_manager.cc:1397] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260812 20:58:01.160557 12064 raft_consensus.cc:348] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.160751 12064 raft_consensus.cc:374] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:01.160842 12064 raft_consensus.cc:729] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3f0e06506b04fb5809bd29ea68709f5, State: Initialized, Role: FOLLOWER
I20260812 20:58:01.161008 12064 consensus_queue.cc:260] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.161087 12065 raft_consensus.cc:348] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.161283 12065 raft_consensus.cc:374] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:01.161326 12065 raft_consensus.cc:729] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be60df0cfc90416e9da67d5bd799df74, State: Initialized, Role: FOLLOWER
I20260812 20:58:01.161379 12064 ts_tablet_manager.cc:1428] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 20:58:01.161610 11624 heartbeater.cc:503] Master 127.10.30.126:43367 was elected leader, sending a full tablet report...
I20260812 20:58:01.162070 12065 consensus_queue.cc:260] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.162482 12044 heartbeater.cc:503] Master 127.10.30.126:43367 was elected leader, sending a full tablet report...
I20260812 20:58:01.162557 12063 raft_consensus.cc:348] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.162742 12063 raft_consensus.cc:374] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:01.162832 12063 raft_consensus.cc:729] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2d9b7fb4134361a324c5f70671eb27, State: Initialized, Role: FOLLOWER
I20260812 20:58:01.162878 12065 ts_tablet_manager.cc:1428] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260812 20:58:01.163264 12063 consensus_queue.cc:260] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.163650 12063 ts_tablet_manager.cc:1428] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260812 20:58:01.163682 11836 heartbeater.cc:503] Master 127.10.30.126:43367 was elected leader, sending a full tablet report...
W20260812 20:58:01.188596 11625 tablet.cc:2369] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:01.210522 12074 raft_consensus.cc:482] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:01.210742 12074 raft_consensus.cc:504] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.211652 12074 leader_election.cc:288] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2d9b7fb4134361a324c5f70671eb27 (127.10.30.66:35561), be60df0cfc90416e9da67d5bd799df74 (127.10.30.67:42043)
I20260812 20:58:01.215194 12081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.211955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35561 (local address 127.10.30.65:35169)
0812 20:58:01.212138 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:01.212154 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:01.212244 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:01.212445 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:01.212447 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:01.212451 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:01.212586 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.212589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.213364 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.213365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.214243 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.214245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.214843 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.214844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.214924 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.214930 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 20:58:01.214999 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 20:58:01.215081 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260812 20:58:01.215178 12058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.212110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:35169 (local address 127.10.30.66:35561)
0812 20:58:01.212182 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.212184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.212217 (+ 33us) server_negotiation.cc:407] Connection header received
0812 20:58:01.212319 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.212321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.212338 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.212423 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:01.212694 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.213265 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.214351 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.214753 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.214843 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.214855 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.215050 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.215103 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 20:58:01.215312 12062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.212362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:49743 (local address 127.10.30.67:42043)
0812 20:58:01.212453 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.212456 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.212631 (+ 175us) server_negotiation.cc:407] Connection header received
0812 20:58:01.212709 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.212710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.212728 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.212794 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:01.212968 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.213460 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.214456 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.214883 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.214971 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.214981 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.215182 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.215238 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 20:58:01.215304 12082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.212246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42043 (local address 127.10.30.65:49743)
0812 20:58:01.212547 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:01.212555 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:01.212644 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:01.212799 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:01.212800 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:01.212801 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:01.212898 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.212900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.213552 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.213553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.214351 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:01.214353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.214971 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.214972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:01.215084 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.215089 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:01.215171 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 20:58:01.215216 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":210,"threads_started":1}
I20260812 20:58:01.216081 11972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d49c88f9b5647e5ab919bbbe9e5e198" candidate_uuid: "b3f0e06506b04fb5809bd29ea68709f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be60df0cfc90416e9da67d5bd799df74" is_pre_election: true
I20260812 20:58:01.216346 11972 raft_consensus.cc:2454] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3f0e06506b04fb5809bd29ea68709f5 in term 0.
I20260812 20:58:01.216693 11438 leader_election.cc:302] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3f0e06506b04fb5809bd29ea68709f5, be60df0cfc90416e9da67d5bd799df74; no voters:
I20260812 20:58:01.216838 12074 raft_consensus.cc:2781] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:01.216881 12074 raft_consensus.cc:482] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:01.216898 12074 raft_consensus.cc:3037] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:01.216080 11756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d49c88f9b5647e5ab919bbbe9e5e198" candidate_uuid: "b3f0e06506b04fb5809bd29ea68709f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2d9b7fb4134361a324c5f70671eb27" is_pre_election: true
I20260812 20:58:01.217836 12074 raft_consensus.cc:504] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.218024 12074 leader_election.cc:288] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2d9b7fb4134361a324c5f70671eb27 (127.10.30.66:35561), be60df0cfc90416e9da67d5bd799df74 (127.10.30.67:42043)
I20260812 20:58:01.218072 11756 raft_consensus.cc:2454] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3f0e06506b04fb5809bd29ea68709f5 in term 0.
I20260812 20:58:01.218356 11756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d49c88f9b5647e5ab919bbbe9e5e198" candidate_uuid: "b3f0e06506b04fb5809bd29ea68709f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2d9b7fb4134361a324c5f70671eb27"
I20260812 20:58:01.218389 11972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d49c88f9b5647e5ab919bbbe9e5e198" candidate_uuid: "b3f0e06506b04fb5809bd29ea68709f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be60df0cfc90416e9da67d5bd799df74"
I20260812 20:58:01.218477 11756 raft_consensus.cc:3037] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:01.218568 11972 raft_consensus.cc:3037] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:01.219563 11756 raft_consensus.cc:2454] T 6d49c88f9b5647e5ab919bbbe9e5e198 P 5f2d9b7fb4134361a324c5f70671eb27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3f0e06506b04fb5809bd29ea68709f5 in term 1.
I20260812 20:58:01.219718 11972 raft_consensus.cc:2454] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3f0e06506b04fb5809bd29ea68709f5 in term 1.
I20260812 20:58:01.219760 11438 leader_election.cc:302] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2d9b7fb4134361a324c5f70671eb27, b3f0e06506b04fb5809bd29ea68709f5; no voters:
I20260812 20:58:01.219861 12074 raft_consensus.cc:2781] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:01.220084 12074 raft_consensus.cc:686] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [term 1 LEADER]: Becoming Leader. State: Replica: b3f0e06506b04fb5809bd29ea68709f5, State: Running, Role: LEADER
I20260812 20:58:01.220223 12074 consensus_queue.cc:237] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } }
I20260812 20:58:01.221520 11291 catalog_manager.cc:5495] T 6d49c88f9b5647e5ab919bbbe9e5e198 P b3f0e06506b04fb5809bd29ea68709f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3f0e06506b04fb5809bd29ea68709f5 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "b3f0e06506b04fb5809bd29ea68709f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f2d9b7fb4134361a324c5f70671eb27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be60df0cfc90416e9da67d5bd799df74" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3f0e06506b04fb5809bd29ea68709f5" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34405 } health_report { overall_health: HEALTHY } } }
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[11212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:58:01.249243 12061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.239330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55322 (local address 127.10.30.65:34405)
0812 20:58:01.239461 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.239464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.239554 (+ 90us) server_negotiation.cc:407] Connection header received
0812 20:58:01.239646 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.239647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.239666 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.239741 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:01.240497 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.241045 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.241836 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.242055 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.242137 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.245247 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:01.245272 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:01.245272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:01.245283 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:01.247584 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.248067 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.248071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.248071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.248152 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.248435 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.248437 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.248437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.248657 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:01.248808 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.249027 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.249120 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568281, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[11212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568281, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:58:01.282733 12061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.272972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55324 (local address 127.10.30.65:34405)
0812 20:58:01.273092 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.273095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.273170 (+ 75us) server_negotiation.cc:407] Connection header received
0812 20:58:01.273286 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.273287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.273303 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.273375 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:01.274177 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.274742 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.275835 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.276108 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.276249 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.279111 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:01.279113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:01.279114 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:01.279131 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:01.280941 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.281371 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.281373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.281373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.281450 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.281715 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.281717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.281717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.281959 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:01.282185 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.282444 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.282578 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[11212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:58:01.313675 12061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:01.305181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55332 (local address 127.10.30.65:34405)
0812 20:58:01.305262 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:01.305265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:01.305287 (+ 22us) server_negotiation.cc:407] Connection header received
0812 20:58:01.305405 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:01.305406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:01.305420 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:01.305483 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:01.306184 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.306739 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.307669 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:01.307889 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:01.307971 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:01.310772 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:01.310775 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:01.310775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:01.310791 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:01.312377 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.312795 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.312797 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.312798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.312865 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:01.313082 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:01.313082 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:01.313083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:01.313206 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:01.313357 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:01.313448 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 20:58:01.313547 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 20:58:01.314636 11481 tablet_service.cc:2908] Rejecting scan request for tablet 6d49c88f9b5647e5ab919bbbe9e5e198: Uninitialized: clean time has not yet been initialized
I20260812 20:58:01.316079 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 11403
I20260812 20:58:01.337935 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 11632
W20260812 20:58:01.350989 12045 tablet.cc:2369] T 6d49c88f9b5647e5ab919bbbe9e5e198 P be60df0cfc90416e9da67d5bd799df74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:01.360337 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 11842
I20260812 20:58:01.378583 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 11239
2026-08-12T20:58:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2641 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[12106](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[12106](info): set up 2 sockets
Aug 12 20:58:01 dist-test-slave-h3ft krb5kdc[12106](info): commencing operation
krb5kdc: starting...
W20260812 20:58:02.757817 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:02 dist-test-slave-h3ft krb5kdc[12106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:02.910955 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:33897
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:33897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:03.013091 12127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:03.013399 12127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:03.013432 12127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:03.014827 12127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:03.014889 12127 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 20:58:03.014909 12127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:03.014923 12127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:03.014935 12127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:03.014948 12127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:03.016793 12127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:33897
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:33897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:03.017153 12127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:03.017460 12127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:03.023948 12138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:03.024088 12127 server_base.cc:1034] running on GCE node
W20260812 20:58:03.024055 12136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:03.024055 12140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:03.024729 12127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:03.025096 12127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:03.026274 12127 hybrid_clock.cc:648] HybridClock initialized: now 1786568283026236 us; error 66 us; skew 500 ppm
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:03.029935 12127 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:03.030799 12127 webserver.cc:460] Webserver started at http://127.10.30.126:33535/ using document root <none> and password file <none>
I20260812 20:58:03.031198 12127 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:03.031279 12127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:03.031454 12127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:03.033092 12127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "4082d5415e294247b45e4ecec692c835"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "37eaeab77330aa7ae2fe223d31ecc1ff"
server_key_iv: "902d333f377960fe2f10e41414e290c4"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.033578 12127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "4082d5415e294247b45e4ecec692c835"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "37eaeab77330aa7ae2fe223d31ecc1ff"
server_key_iv: "902d333f377960fe2f10e41414e290c4"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.035441 12127 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:03.036616 12152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:03.037016 12127 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:03.037164 12127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "4082d5415e294247b45e4ecec692c835"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "37eaeab77330aa7ae2fe223d31ecc1ff"
server_key_iv: "902d333f377960fe2f10e41414e290c4"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.037263 12127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:03.065104 12127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:03.068156 12127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:03.068378 12127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:03.075429 12127 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:33897
I20260812 20:58:03.075486 12260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:33897 every 8 connection(s)
I20260812 20:58:03.075989 12127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:03.076977 12261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:03.079726 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12127
I20260812 20:58:03.079860 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:03.080057 10361 external_mini_cluster.cc:1428] Setting key 1dc0c09d591a8050c8d408171bc6ebd5
I20260812 20:58:03.080711 12261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835: Bootstrap starting.
I20260812 20:58:03.081984 12261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:03.082399 12261 log.cc:824] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:03.084225 12261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835: No bootstrap required, opened a new log
I20260812 20:58:03.087337 12261 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4082d5415e294247b45e4ecec692c835" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33897 } }
I20260812 20:58:03.087621 12261 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:03.087687 12261 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4082d5415e294247b45e4ecec692c835, State: Initialized, Role: FOLLOWER
I20260812 20:58:03.087921 12261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4082d5415e294247b45e4ecec692c835" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33897 } }
I20260812 20:58:03.088059 12261 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:03.088102 12261 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:03.088166 12261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:03.089107 12261 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4082d5415e294247b45e4ecec692c835" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33897 } }
I20260812 20:58:03.089241 12261 leader_election.cc:302] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4082d5415e294247b45e4ecec692c835; no voters:
I20260812 20:58:03.089511 12261 leader_election.cc:288] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:03.089593 12269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:03.089818 12269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [term 1 LEADER]: Becoming Leader. State: Replica: 4082d5415e294247b45e4ecec692c835, State: Running, Role: LEADER
I20260812 20:58:03.089956 12261 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:03.090016 12269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4082d5415e294247b45e4ecec692c835" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33897 } }
I20260812 20:58:03.090564 12271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4082d5415e294247b45e4ecec692c835. Latest consensus state: current_term: 1 leader_uuid: "4082d5415e294247b45e4ecec692c835" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4082d5415e294247b45e4ecec692c835" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33897 } } }
I20260812 20:58:03.090698 12271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [sys.catalog]: This master's current role is: LEADER
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:03.090546 12270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4082d5415e294247b45e4ecec692c835" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4082d5415e294247b45e4ecec692c835" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33897 } } }
I20260812 20:58:03.090902 12270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:03.091851 12280 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:03.092819 12280 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:03.095093 12280 catalog_manager.cc:1347] Generated new cluster ID: d8346ed1879742ea881b566b38562455
I20260812 20:58:03.095178 12280 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:03.096406 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.080919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55614 (local address 127.10.30.126:33897)
0812 20:58:03.081517 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.081536 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.081573 (+ 37us) server_negotiation.cc:407] Connection header received
0812 20:58:03.082275 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.082285 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.082357 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.082576 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:03.083664 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.085370 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.086603 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.087321 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.087497 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.091789 (+ 4292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:03.091796 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:03.091796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:03.091816 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:03.094269 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.094822 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.094826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.094827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.094962 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.095261 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.095262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.095263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.095647 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:03.095821 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.095968 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.096144 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":122,"threads_started":1}
I20260812 20:58:03.122435 12280 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:03.123289 12280 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:03.128005 12280 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835: Generated new TSK 0
I20260812 20:58:03.128324 12280 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:03.176566 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33897
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:03.276628 12302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:03.276968 12302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:03.277017 12302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:03.278358 12302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:03.278434 12302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:03.278472 12302 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:03.278517 12302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:03.280201 12302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:33897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:03.280534 12302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:03.280819 12302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:03.286712 12312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:03.286715 12311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:03.286768 12315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:03.287282 12302 server_base.cc:1034] running on GCE node
I20260812 20:58:03.287598 12302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:03.287912 12302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:03.289140 12302 hybrid_clock.cc:648] HybridClock initialized: now 1786568283289115 us; error 43 us; skew 500 ppm
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:03.292479 12302 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:03.293045 12302 webserver.cc:460] Webserver started at http://127.10.30.65:39279/ using document root <none> and password file <none>
I20260812 20:58:03.293322 12302 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:03.293372 12302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:03.293565 12302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:03.294816 12302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "3129e5f1b18d4c579952f8c8209be783"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "eaf90b7a8b2be940642efbd786424c93"
server_key_iv: "342494fd7ee18ce2e6030e935b4462ff"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.295291 12302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "3129e5f1b18d4c579952f8c8209be783"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "eaf90b7a8b2be940642efbd786424c93"
server_key_iv: "342494fd7ee18ce2e6030e935b4462ff"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.296878 12302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:03.298002 12327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:03.298269 12302 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:03.298398 12302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "3129e5f1b18d4c579952f8c8209be783"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "eaf90b7a8b2be940642efbd786424c93"
server_key_iv: "342494fd7ee18ce2e6030e935b4462ff"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.298493 12302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:03.309286 12302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:03.311964 12302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:03.312111 12302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:03.312749 12302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:03.312803 12302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:03.312830 12302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:03.312844 12302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:03.322387 12302 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:33609
I20260812 20:58:03.322520 12508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:33609 every 8 connection(s)
I20260812 20:58:03.322947 12302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:58:03.324548 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12302
I20260812 20:58:03.324651 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:03.324910 10361 external_mini_cluster.cc:1428] Setting key c0d32150a101c36a4e04d1fdac6866b9
I20260812 20:58:03.326180 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.313505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:45847 (local address 127.10.30.126:33897)
0812 20:58:03.313594 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.313597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.313816 (+ 219us) server_negotiation.cc:407] Connection header received
0812 20:58:03.314704 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.314707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.314725 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.314815 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:03.315956 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.316916 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.318121 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.318532 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.318636 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.322243 (+ 3607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:03.322245 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:03.322245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:03.322255 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:03.324153 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.324786 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.324788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.324788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.324871 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.325211 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.325212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.325212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.325358 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:03.325453 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.325848 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.325982 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:03.326203 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.313417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33897 (local address 127.10.30.65:45847)
0812 20:58:03.313655 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.313704 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.314547 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.314924 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.314931 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.315443 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:03.315808 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.315818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.317069 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.317071 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.318033 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.318036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.318665 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.318666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.318832 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.319624 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:03.319634 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:03.322096 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:03.324251 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.324258 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.324260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.324677 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.324946 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.324946 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.324947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.325131 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.325440 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:03.325450 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:03.325670 (+ 220us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.325811 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.325994 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":133,"threads_started":1}
I20260812 20:58:03.326903 12511 heartbeater.cc:347] Connected to a master server at 127.10.30.126:33897
I20260812 20:58:03.327054 12511 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:03.327306 12511 heartbeater.cc:511] Master 127.10.30.126:33897 requested a full tablet report, sending...
I20260812 20:58:03.327942 12180 ts_manager.cc:194] Registered new tserver with Master: 3129e5f1b18d4c579952f8c8209be783 (127.10.30.65:33609)
I20260812 20:58:03.328976 12180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:45847
I20260812 20:58:03.335871 12521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.328315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33897 (local address 127.10.30.65:41889)
0812 20:58:03.328514 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.328528 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.328607 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.328747 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.328747 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.328977 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:03.329088 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.329091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.330066 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.330067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.330595 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.330597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.331160 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.331161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.331233 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.331847 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:03.331852 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:03.332371 (+ 519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:03.334595 (+ 2224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.334596 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.334596 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.334817 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.335101 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.335103 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.335103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.335178 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.335516 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:03.335517 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:03.335606 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.335668 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.335774 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":116,"threads_started":1}
I20260812 20:58:03.335944 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.328378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:41889 (local address 127.10.30.126:33897)
0812 20:58:03.328426 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.328429 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.328611 (+ 182us) server_negotiation.cc:407] Connection header received
0812 20:58:03.328653 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.328654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.328668 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.328741 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:03.329194 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.329939 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.330683 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.331050 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.331128 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.332477 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:03.332479 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:03.332479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:03.332488 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:03.334480 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.334900 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.334902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.334902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.334978 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.335255 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.335257 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.335257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.335437 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:03.335530 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.335728 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.335826 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:03.363605 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33897
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:03.465533 12525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:03.465867 12525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:03.465905 12525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:03.467535 12525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:03.467588 12525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:03.467612 12525 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:03.467631 12525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:03.469417 12525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:33897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:03.469748 12525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:03.470060 12525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:03.476527 12534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:03.476539 12532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:03.476550 12536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:03.476804 12525 server_base.cc:1034] running on GCE node
I20260812 20:58:03.477154 12525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:03.477458 12525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:03.478658 12525 hybrid_clock.cc:648] HybridClock initialized: now 1786568283478619 us; error 59 us; skew 500 ppm
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:03.482122 12525 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:03.482772 12525 webserver.cc:460] Webserver started at http://127.10.30.66:45377/ using document root <none> and password file <none>
I20260812 20:58:03.483157 12525 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:03.483214 12525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:03.483330 12525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:03.484609 12525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "7390a0775a9e4c24ad738d031a96a387"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "ea082610f0069c210a7bef40bea50f26"
server_key_iv: "44ea06f8c86f030536201c3cc9965030"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.484980 12525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "7390a0775a9e4c24ad738d031a96a387"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "ea082610f0069c210a7bef40bea50f26"
server_key_iv: "44ea06f8c86f030536201c3cc9965030"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.486539 12525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 20:58:03.487543 12547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:03.487802 12525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:03.487912 12525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "7390a0775a9e4c24ad738d031a96a387"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "ea082610f0069c210a7bef40bea50f26"
server_key_iv: "44ea06f8c86f030536201c3cc9965030"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.488027 12525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:03.513684 12525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:03.516568 12525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:03.516726 12525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:03.517417 12525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:03.517470 12525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:03.517501 12525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:03.517514 12525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:03.526172 12525 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:42499
I20260812 20:58:03.526276 12733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:42499 every 8 connection(s)
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:03.526736 12525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:03.531123 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.518103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:54333 (local address 127.10.30.126:33897)
0812 20:58:03.518195 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.518199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.518452 (+ 253us) server_negotiation.cc:407] Connection header received
0812 20:58:03.519213 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.519214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.519231 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.519305 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:03.520437 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.521355 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.523221 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.523609 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.523723 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.527259 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:03.527262 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:03.527262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:03.527273 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:03.529122 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.529702 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.529704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.529704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.529780 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.530173 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.530174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.530174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.530326 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:03.530384 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.530826 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.530932 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 20:58:03.531383 12557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.518077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33897 (local address 127.10.30.66:54333)
0812 20:58:03.518283 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.518335 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.519089 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.519409 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.519415 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.519905 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:03.520314 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.520323 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.521465 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.521466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.522990 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.523104 (+ 114us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.523733 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.523734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.523877 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.524686 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:03.524704 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:03.527096 (+ 2392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:03.529253 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.529263 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.529266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.529576 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.529873 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.529875 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.529875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.530087 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.530416 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:03.530424 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:03.530596 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.530742 (+ 146us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.530996 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":121,"threads_started":1}
I20260812 20:58:03.532023 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12525
I20260812 20:58:03.532058 12734 heartbeater.cc:347] Connected to a master server at 127.10.30.126:33897
I20260812 20:58:03.532162 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:03.532171 12734 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:03.532425 10361 external_mini_cluster.cc:1428] Setting key c0220c3ada2cb60b2051c56a948f250c
I20260812 20:58:03.532434 12734 heartbeater.cc:511] Master 127.10.30.126:33897 requested a full tablet report, sending...
I20260812 20:58:03.533119 12180 ts_manager.cc:194] Registered new tserver with Master: 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499)
I20260812 20:58:03.533645 12180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:54333
I20260812 20:58:03.542336 12745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.533791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33897 (local address 127.10.30.66:47007)
0812 20:58:03.534024 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.534042 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.534142 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.534392 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.534394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.534696 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:03.534808 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.534812 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.535749 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.535750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.536737 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.536740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.537268 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.537269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.537348 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.538086 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:03.538094 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:03.538694 (+ 600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:03.540664 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.540666 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.540666 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.540999 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.541232 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.541233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.541233 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.541325 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.541798 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:03.541800 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:03.541880 (+ 80us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.542043 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.542224 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":125,"threads_started":1}
I20260812 20:58:03.542402 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.533671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:47007 (local address 127.10.30.126:33897)
0812 20:58:03.533746 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.533749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.534108 (+ 359us) server_negotiation.cc:407] Connection header received
0812 20:58:03.534220 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.534221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.534235 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.534302 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:03.534964 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.535634 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.536828 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.537161 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.537249 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.538822 (+ 1573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:03.538824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:03.538825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:03.538834 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:03.540565 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.541090 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.541091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.541091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.541161 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.541405 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.541406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.541407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.541697 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:03.541786 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.542144 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.542255 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:03.572623 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33897
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:35665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:03.675122 12749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:03.675410 12749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:03.675441 12749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:03.676923 12749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:03.676987 12749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:03.677011 12749 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:03.677030 12749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:03.678963 12749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:35665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:33897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:03.679344 12749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:03.679658 12749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:03.686060 12761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:03.686070 12763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:03.686085 12760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:03.686614 12749 server_base.cc:1034] running on GCE node
I20260812 20:58:03.686869 12749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:03.687211 12749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:03.688380 12749 hybrid_clock.cc:648] HybridClock initialized: now 1786568283688366 us; error 35 us; skew 500 ppm
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:03.692080 12749 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:03.692679 12749 webserver.cc:460] Webserver started at http://127.10.30.67:33081/ using document root <none> and password file <none>
I20260812 20:58:03.692961 12749 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:03.693022 12749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:03.693181 12749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:03.694502 12749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "c4abb11d46ad4d28b7b0c7a75abb2997"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "217e95ca95987df85406513169bd7b51"
server_key_iv: "6d20c6e1e54069d30a03fb0d558db143"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.694940 12749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "c4abb11d46ad4d28b7b0c7a75abb2997"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "217e95ca95987df85406513169bd7b51"
server_key_iv: "6d20c6e1e54069d30a03fb0d558db143"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.696739 12749 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:03.697822 12774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:03.698096 12749 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:03.698233 12749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "c4abb11d46ad4d28b7b0c7a75abb2997"
format_stamp: "Formatted at 2026-08-12 20:58:03 on dist-test-slave-h3ft"
server_key: "217e95ca95987df85406513169bd7b51"
server_key_iv: "6d20c6e1e54069d30a03fb0d558db143"
server_key_version: "encryptionkey@0"
I20260812 20:58:03.698335 12749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:03.709802 12749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:03.712870 12749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:03.713093 12749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:03.713797 12749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:03.713865 12749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:03.713941 12749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:03.713972 12749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:03.723567 12749 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:46641
I20260812 20:58:03.723652 12961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:46641 every 8 connection(s)
I20260812 20:58:03.724048 12749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:03.727144 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.714594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:46965 (local address 127.10.30.126:33897)
0812 20:58:03.714669 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.714671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.715030 (+ 359us) server_negotiation.cc:407] Connection header received
0812 20:58:03.715811 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.715813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.715834 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.715920 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:03.717113 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.718048 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.719423 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.719651 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.719737 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.723057 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:03.723059 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:03.723060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:03.723070 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:03.724959 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.725752 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.725754 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.725754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.725865 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.726208 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.726209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.726209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.726359 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:03.726423 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.726826 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.727039 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 20:58:03.727361 12789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.714593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33897 (local address 127.10.30.67:46965)
0812 20:58:03.714826 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.714881 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.715628 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.716037 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.716044 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.716559 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:03.716975 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.716983 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.718189 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.718190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.719301 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.719305 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.719767 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.719768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.719930 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.720858 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:03.720870 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:03.722884 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:03.725085 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.725093 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.725096 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.725467 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.725963 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.725965 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.725966 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.726130 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.726444 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:03.726452 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:03.726627 (+ 175us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.726784 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.727056 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":126,"threads_started":1}
I20260812 20:58:03.728093 12962 heartbeater.cc:347] Connected to a master server at 127.10.30.126:33897
I20260812 20:58:03.728196 12962 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:03.728454 12962 heartbeater.cc:511] Master 127.10.30.126:33897 requested a full tablet report, sending...
I20260812 20:58:03.728961 12180 ts_manager.cc:194] Registered new tserver with Master: c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641)
I20260812 20:58:03.729516 12180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:46965
I20260812 20:58:03.730989 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12749
I20260812 20:58:03.731199 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:03.731436 10361 external_mini_cluster.cc:1428] Setting key 0b54bfe0bfb257d27e2c7b1b4397517b
I20260812 20:58:03.732645 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:58:03.737670 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.729625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:36789 (local address 127.10.30.126:33897)
0812 20:58:03.729691 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.729693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.730059 (+ 366us) server_negotiation.cc:407] Connection header received
0812 20:58:03.730090 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.730091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.730106 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.730186 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:03.730543 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.731260 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.732379 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.732676 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.732765 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.734218 (+ 1453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:03.734219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:03.734220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:03.734228 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:03.736103 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.736610 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.736611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.736612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.736693 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.736966 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.736967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.736968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.737127 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:03.737235 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.737432 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.737547 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 20:58:03.737689 12971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.729563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33897 (local address 127.10.30.67:36789)
0812 20:58:03.729939 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.729950 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.730008 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.730188 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.730189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.730394 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:03.730470 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.730472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.731358 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.731359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.732291 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.732295 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.732789 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.732790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.732882 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.733525 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:03.733531 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:03.734080 (+ 549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:03.736233 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.736235 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.736236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.736495 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.736775 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:03.736777 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:03.736777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:03.736887 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:03.737225 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:03.737227 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:03.737299 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.737397 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.737548 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":107,"threads_started":1}
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 20:58:03 dist-test-slave-h3ft krb5kdc[12106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:03.764276 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.755618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55622 (local address 127.10.30.126:33897)
0812 20:58:03.755700 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.755703 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.755719 (+ 16us) server_negotiation.cc:407] Connection header received
0812 20:58:03.755753 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.755754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.755765 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.755840 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:03.756558 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.757135 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.757969 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.758176 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.758257 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.761074 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:03.761077 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:03.761077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:03.761087 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:03.762806 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.763334 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.763336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.763337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.763411 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:03.763660 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:03.763661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:03.763662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:03.763810 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:03.763932 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.764049 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.764149 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 20:58:03.766564 12180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:03.768953 12180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:03.776825 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.772463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58120 (local address 127.10.30.66:42499)
0812 20:58:03.772739 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.772742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.772752 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:03.772801 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.772803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.772819 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.773152 (+ 333us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:03.773242 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.774030 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.775618 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.776323 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.776418 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.776510 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.776623 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.776673 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":183,"threads_started":1}
I20260812 20:58:03.776818 12996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.772203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:42499 (local address 127.0.0.1:58120)
0812 20:58:03.772385 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.772397 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.772462 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.772925 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.772926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.772927 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:03.773068 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.773071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.774127 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.774128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.775487 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.775490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.776417 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.776419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.776504 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.776521 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.776603 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.776672 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":17,"thread_start_us":102,"threads_started":1}
I20260812 20:58:03.776966 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.771941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:33609 (local address 127.0.0.1:54680)
0812 20:58:03.772134 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.772184 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.772276 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.772905 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.772909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.772913 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:03.773157 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.773159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.774540 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.774541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.775645 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.775647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.776653 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.776654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.776730 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.776735 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.776783 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.776844 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":117,"thread_start_us":103,"threads_started":1}
I20260812 20:58:03.777161 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.772437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:46641 (local address 127.0.0.1:48194)
0812 20:58:03.772835 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.772847 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.772909 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.773386 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.773387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.773389 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:03.773434 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.773436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.774829 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.774830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.775821 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.775825 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.776881 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.776882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.776943 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.776947 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.776995 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.777058 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":79,"threads_started":1}
I20260812 20:58:03.777621 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.772601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.10.30.67:46641)
0812 20:58:03.773088 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.773093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.773103 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:03.773154 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.773156 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.773173 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.773285 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:03.773537 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.774658 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.775920 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.776672 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.776736 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.776844 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.777446 (+ 602us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.777501 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":106,"threads_started":1}
I20260812 20:58:03.777912 12625 tablet_service.cc:1467] Processing CreateTablet for tablet f2ac07d222b9486e8b0c18ff428cfa9b (DEFAULT_TABLE table=test-table [id=abd942282b944962841fd93b09b60fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:03.778170 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.772155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54680 (local address 127.10.30.65:33609)
0812 20:58:03.772663 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.772670 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.772683 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:03.772738 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.772740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.772762 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.773033 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:03.773252 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.774441 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.775739 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.776540 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.777867 (+ 1327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.777956 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.777985 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.778040 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":140,"threads_started":1}
I20260812 20:58:03.778482 12625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2ac07d222b9486e8b0c18ff428cfa9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:03.778623 12857 tablet_service.cc:1467] Processing CreateTablet for tablet f2ac07d222b9486e8b0c18ff428cfa9b (DEFAULT_TABLE table=test-table [id=abd942282b944962841fd93b09b60fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:03.778868 12406 tablet_service.cc:1467] Processing CreateTablet for tablet f2ac07d222b9486e8b0c18ff428cfa9b (DEFAULT_TABLE table=test-table [id=abd942282b944962841fd93b09b60fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:03.779102 12857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2ac07d222b9486e8b0c18ff428cfa9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:03.779312 12406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2ac07d222b9486e8b0c18ff428cfa9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:03.782646 13002 tablet_bootstrap.cc:492] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: Bootstrap starting.
I20260812 20:58:03.783269 13003 tablet_bootstrap.cc:492] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: Bootstrap starting.
I20260812 20:58:03.783728 13002 tablet_bootstrap.cc:654] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:03.783710 13004 tablet_bootstrap.cc:492] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Bootstrap starting.
I20260812 20:58:03.784157 13002 log.cc:824] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:03.784461 13004 tablet_bootstrap.cc:654] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:03.784461 13003 tablet_bootstrap.cc:654] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:03.784891 13004 log.cc:824] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:03.784891 13003 log.cc:824] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:03.785166 13002 tablet_bootstrap.cc:492] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: No bootstrap required, opened a new log
I20260812 20:58:03.785265 13002 ts_tablet_manager.cc:1397] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:58:03.785761 13003 tablet_bootstrap.cc:492] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: No bootstrap required, opened a new log
I20260812 20:58:03.785863 13003 ts_tablet_manager.cc:1397] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:58:03.787133 13002 raft_consensus.cc:348] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.787333 13002 raft_consensus.cc:374] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:03.787380 13002 raft_consensus.cc:729] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7390a0775a9e4c24ad738d031a96a387, State: Initialized, Role: FOLLOWER
I20260812 20:58:03.787489 13004 tablet_bootstrap.cc:492] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: No bootstrap required, opened a new log
I20260812 20:58:03.787582 13004 ts_tablet_manager.cc:1397] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 20:58:03.787588 13002 consensus_queue.cc:260] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.787853 13003 raft_consensus.cc:348] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.787976 13002 ts_tablet_manager.cc:1428] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 20:58:03.787998 12734 heartbeater.cc:503] Master 127.10.30.126:33897 was elected leader, sending a full tablet report...
I20260812 20:58:03.788039 13003 raft_consensus.cc:374] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:03.788077 13003 raft_consensus.cc:729] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4abb11d46ad4d28b7b0c7a75abb2997, State: Initialized, Role: FOLLOWER
I20260812 20:58:03.788199 13003 consensus_queue.cc:260] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.788499 13003 ts_tablet_manager.cc:1428] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 20:58:03.788987 12962 heartbeater.cc:503] Master 127.10.30.126:33897 was elected leader, sending a full tablet report...
I20260812 20:58:03.789940 13004 raft_consensus.cc:348] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.790151 13004 raft_consensus.cc:374] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:03.790180 13004 raft_consensus.cc:729] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3129e5f1b18d4c579952f8c8209be783, State: Initialized, Role: FOLLOWER
I20260812 20:58:03.790346 13004 consensus_queue.cc:260] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.790661 13004 ts_tablet_manager.cc:1428] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 20:58:03.790803 12511 heartbeater.cc:503] Master 127.10.30.126:33897 was elected leader, sending a full tablet report...
W20260812 20:58:03.824819 12513 tablet.cc:2369] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:03.881994 13014 raft_consensus.cc:482] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:03.882261 13014 raft_consensus.cc:504] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.882820 13014 leader_election.cc:288] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499), c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641)
I20260812 20:58:03.887712 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.883274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:37913 (local address 127.10.30.66:42499)
0812 20:58:03.883343 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.883346 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.883408 (+ 62us) server_negotiation.cc:407] Connection header received
0812 20:58:03.883536 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.883537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.883552 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.883639 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:03.883924 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.884741 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.886604 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.887240 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.887328 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.887344 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.887563 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.887618 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 20:58:03.887712 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.883515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:52921 (local address 127.10.30.67:46641)
0812 20:58:03.883570 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.883572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.883588 (+ 16us) server_negotiation.cc:407] Connection header received
0812 20:58:03.883682 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.883682 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.883693 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.883752 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:03.883912 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.884742 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.886604 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.887295 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.887366 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.887375 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.887563 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.887615 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 20:58:03.887799 13018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.883402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:46641 (local address 127.10.30.65:52921)
0812 20:58:03.883535 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.883545 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.883595 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.883772 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.883772 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.883775 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:03.883827 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.883831 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.884877 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.884879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.886457 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.886462 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.887373 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.887373 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.887471 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.887479 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.887542 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.887671 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":135,"thread_start_us":95,"threads_started":1}
I20260812 20:58:03.887816 13017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.883126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:42499 (local address 127.10.30.65:37913)
0812 20:58:03.883320 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:03.883336 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:03.883421 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:03.883678 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:03.883679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:03.883683 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:03.883827 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.883833 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.884877 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.884879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.886457 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:03.886462 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.887371 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.887372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:03.887471 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.887481 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 20:58:03.887542 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 20:58:03.887671 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":130,"thread_start_us":129,"threads_started":1}
I20260812 20:58:03.888305 12889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2ac07d222b9486e8b0c18ff428cfa9b" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" is_pre_election: true
I20260812 20:58:03.888305 12663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2ac07d222b9486e8b0c18ff428cfa9b" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7390a0775a9e4c24ad738d031a96a387" is_pre_election: true
I20260812 20:58:03.888532 12889 raft_consensus.cc:2454] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 0.
I20260812 20:58:03.888532 12663 raft_consensus.cc:2454] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 0.
I20260812 20:58:03.888826 12329 leader_election.cc:302] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3129e5f1b18d4c579952f8c8209be783, c4abb11d46ad4d28b7b0c7a75abb2997; no voters:
I20260812 20:58:03.888978 13014 raft_consensus.cc:2781] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:03.889043 13014 raft_consensus.cc:482] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:03.889067 13014 raft_consensus.cc:3037] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:03.890244 13014 raft_consensus.cc:504] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.890458 13014 leader_election.cc:288] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 election: Requested vote from peers 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499), c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641)
I20260812 20:58:03.890659 12663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2ac07d222b9486e8b0c18ff428cfa9b" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7390a0775a9e4c24ad738d031a96a387"
I20260812 20:58:03.890694 12889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2ac07d222b9486e8b0c18ff428cfa9b" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997"
I20260812 20:58:03.890781 12889 raft_consensus.cc:3037] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:03.890789 12663 raft_consensus.cc:3037] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:03.892023 12663 raft_consensus.cc:2454] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 1.
I20260812 20:58:03.892061 12889 raft_consensus.cc:2454] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 1.
I20260812 20:58:03.892256 12329 leader_election.cc:302] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3129e5f1b18d4c579952f8c8209be783, c4abb11d46ad4d28b7b0c7a75abb2997; no voters:
I20260812 20:58:03.892386 13014 raft_consensus.cc:2781] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:03.892618 13014 raft_consensus.cc:686] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 1 LEADER]: Becoming Leader. State: Replica: 3129e5f1b18d4c579952f8c8209be783, State: Running, Role: LEADER
I20260812 20:58:03.892762 13014 consensus_queue.cc:237] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.893929 12179 catalog_manager.cc:5495] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3129e5f1b18d4c579952f8c8209be783 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:03.927991 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:03.924397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54688 (local address 127.10.30.65:33609)
0812 20:58:03.924497 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:03.924499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:03.924509 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:03.924574 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:03.924577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:03.924608 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:03.924685 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:03.924875 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.925714 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.926880 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:03.927145 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:03.927238 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:03.927545 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:03.927690 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:03.927789 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:03.927838 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 20:58:03.927875 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 20:58:03.930852 12889 raft_consensus.cc:1261] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Refusing update from remote peer 3129e5f1b18d4c579952f8c8209be783: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:03.930889 12663 raft_consensus.cc:1261] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Refusing update from remote peer 3129e5f1b18d4c579952f8c8209be783: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:03.931615 13019 consensus_queue.cc:1035] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:03.931877 13014 consensus_queue.cc:1035] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:03.936084 13023 mvcc.cc:205] Tried to move back new op lower bound from 7317783690976239616 to 7317783690825785344. Current Snapshot: MvccSnapshot[applied={T|T < 7317783690976239616}]
I20260812 20:58:03.936378 13027 mvcc.cc:205] Tried to move back new op lower bound from 7317783690976239616 to 7317783690825785344. Current Snapshot: MvccSnapshot[applied={T|T < 7317783690976239616}]
I20260812 20:58:03.937961 13025 mvcc.cc:205] Tried to move back new op lower bound from 7317783690976239616 to 7317783690825785344. Current Snapshot: MvccSnapshot[applied={T|T < 7317783690976239616}]
I20260812 20:58:03.942596 12180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:03.942807 12180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:03.944087 12180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835: Sending DeleteTablet for 3 replicas of tablet f2ac07d222b9486e8b0c18ff428cfa9b
I20260812 20:58:03.944756 12406 tablet_service.cc:1514] Processing DeleteTablet for tablet f2ac07d222b9486e8b0c18ff428cfa9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:03 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:54680
I20260812 20:58:03.944788 12857 tablet_service.cc:1514] Processing DeleteTablet for tablet f2ac07d222b9486e8b0c18ff428cfa9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:03 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:48194
I20260812 20:58:03.945140 13039 tablet_replica.cc:330] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: stopping tablet replica
I20260812 20:58:03.945286 13039 raft_consensus.cc:2229] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:03.945446 13039 raft_consensus.cc:2258] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:03.945976 13039 ts_tablet_manager.cc:1905] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:03.947110 12625 tablet_service.cc:1514] Processing DeleteTablet for tablet f2ac07d222b9486e8b0c18ff428cfa9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:03 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:58120
I20260812 20:58:03.947517 13040 tablet_replica.cc:330] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: stopping tablet replica
I20260812 20:58:03.947774 13040 raft_consensus.cc:2229] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:03.948021 13040 raft_consensus.cc:2258] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:03.947948 12180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:03.948196 12180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:03.948601 13038 tablet_replica.cc:330] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: stopping tablet replica
I20260812 20:58:03.948797 13038 raft_consensus.cc:2229] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:03.948976 13038 raft_consensus.cc:2258] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:03.948978 13039 ts_tablet_manager.cc:1918] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:03.949093 13039 log.cc:1196] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/f2ac07d222b9486e8b0c18ff428cfa9b
I20260812 20:58:03.949426 13039 ts_tablet_manager.cc:1939] T f2ac07d222b9486e8b0c18ff428cfa9b P 3129e5f1b18d4c579952f8c8209be783: Deleting consensus metadata
I20260812 20:58:03.949618 13038 ts_tablet_manager.cc:1905] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:03.949908 12154 catalog_manager.cc:4841] TS 3129e5f1b18d4c579952f8c8209be783 (127.10.30.65:33609): tablet f2ac07d222b9486e8b0c18ff428cfa9b (table test-table [id=abd942282b944962841fd93b09b60fa3]) successfully deleted
I20260812 20:58:03.951304 12406 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5b956796b645729898a8511dfc9748 (DEFAULT_TABLE table=test-table [id=b3b47248ac7a490d8dd1550f92ff2795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:03.951377 13040 ts_tablet_manager.cc:1905] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:03.951459 12406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5b956796b645729898a8511dfc9748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:03.952529 13038 ts_tablet_manager.cc:1918] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:03.952647 13038 log.cc:1196] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/f2ac07d222b9486e8b0c18ff428cfa9b
I20260812 20:58:03.952986 13038 ts_tablet_manager.cc:1939] T f2ac07d222b9486e8b0c18ff428cfa9b P c4abb11d46ad4d28b7b0c7a75abb2997: Deleting consensus metadata
I20260812 20:58:03.953179 13004 tablet_bootstrap.cc:492] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: Bootstrap starting.
I20260812 20:58:03.953296 12625 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5b956796b645729898a8511dfc9748 (DEFAULT_TABLE table=test-table [id=b3b47248ac7a490d8dd1550f92ff2795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:03.953437 12625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5b956796b645729898a8511dfc9748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:03.953781 13004 tablet_bootstrap.cc:654] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:03.954295 13040 ts_tablet_manager.cc:1918] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:03.954384 13040 log.cc:1196] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/f2ac07d222b9486e8b0c18ff428cfa9b
I20260812 20:58:03.954635 13004 tablet_bootstrap.cc:492] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: No bootstrap required, opened a new log
I20260812 20:58:03.954679 13040 ts_tablet_manager.cc:1939] T f2ac07d222b9486e8b0c18ff428cfa9b P 7390a0775a9e4c24ad738d031a96a387: Deleting consensus metadata
I20260812 20:58:03.954686 13004 ts_tablet_manager.cc:1397] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:03.954909 13004 raft_consensus.cc:348] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.955032 13004 raft_consensus.cc:374] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:03.955061 13004 raft_consensus.cc:729] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3129e5f1b18d4c579952f8c8209be783, State: Initialized, Role: FOLLOWER
I20260812 20:58:03.955024 13002 tablet_bootstrap.cc:492] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: Bootstrap starting.
I20260812 20:58:03.955129 13004 consensus_queue.cc:260] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.955248 13004 ts_tablet_manager.cc:1428] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:03.955549 13002 tablet_bootstrap.cc:654] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:03.956285 13002 tablet_bootstrap.cc:492] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: No bootstrap required, opened a new log
I20260812 20:58:03.956346 13002 ts_tablet_manager.cc:1397] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:03.956542 13002 raft_consensus.cc:348] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.956624 13002 raft_consensus.cc:374] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:03.956647 13002 raft_consensus.cc:729] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7390a0775a9e4c24ad738d031a96a387, State: Initialized, Role: FOLLOWER
I20260812 20:58:03.956699 13002 consensus_queue.cc:260] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.956799 13002 ts_tablet_manager.cc:1428] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 20:58:03.956775 12154 catalog_manager.cc:4841] TS 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499): tablet f2ac07d222b9486e8b0c18ff428cfa9b (table test-table [id=abd942282b944962841fd93b09b60fa3]) successfully deleted
I20260812 20:58:03.956877 12154 catalog_manager.cc:4841] TS c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641): tablet f2ac07d222b9486e8b0c18ff428cfa9b (table test-table [id=abd942282b944962841fd93b09b60fa3]) successfully deleted
I20260812 20:58:03.957131 12857 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5b956796b645729898a8511dfc9748 (DEFAULT_TABLE table=test-table [id=b3b47248ac7a490d8dd1550f92ff2795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:03.957278 12857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5b956796b645729898a8511dfc9748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:03.958636 13003 tablet_bootstrap.cc:492] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: Bootstrap starting.
I20260812 20:58:03.959256 13003 tablet_bootstrap.cc:654] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:03.960047 13003 tablet_bootstrap.cc:492] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: No bootstrap required, opened a new log
I20260812 20:58:03.960114 13003 ts_tablet_manager.cc:1397] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:03.960307 13003 raft_consensus.cc:348] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.960407 13003 raft_consensus.cc:374] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:03.960431 13003 raft_consensus.cc:729] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4abb11d46ad4d28b7b0c7a75abb2997, State: Initialized, Role: FOLLOWER
I20260812 20:58:03.960484 13003 consensus_queue.cc:260] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:03.960589 13003 ts_tablet_manager.cc:1428] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
W20260812 20:58:03.974751 12963 tablet.cc:2369] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 20:58:04.028213 12737 tablet.cc:2369] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:04.028743 13019 raft_consensus.cc:482] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:04.028873 13019 raft_consensus.cc:504] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.029120 13019 leader_election.cc:288] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499), c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641)
I20260812 20:58:04.029491 12663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5b956796b645729898a8511dfc9748" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7390a0775a9e4c24ad738d031a96a387" is_pre_election: true
I20260812 20:58:04.029552 12889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5b956796b645729898a8511dfc9748" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" is_pre_election: true
I20260812 20:58:04.029661 12663 raft_consensus.cc:2454] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 0.
I20260812 20:58:04.029699 12889 raft_consensus.cc:2454] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 0.
I20260812 20:58:04.029868 12329 leader_election.cc:302] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3129e5f1b18d4c579952f8c8209be783, 7390a0775a9e4c24ad738d031a96a387; no voters:
I20260812 20:58:04.030000 13019 raft_consensus.cc:2781] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:04.030062 13019 raft_consensus.cc:482] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:04.030084 13019 raft_consensus.cc:3037] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:04.031467 13019 raft_consensus.cc:504] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.031632 13019 leader_election.cc:288] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 election: Requested vote from peers 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499), c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641)
I20260812 20:58:04.031862 12889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5b956796b645729898a8511dfc9748" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997"
I20260812 20:58:04.031867 12663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5b956796b645729898a8511dfc9748" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7390a0775a9e4c24ad738d031a96a387"
I20260812 20:58:04.031983 12889 raft_consensus.cc:3037] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:04.031983 12663 raft_consensus.cc:3037] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:04.033033 12663 raft_consensus.cc:2454] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 1.
I20260812 20:58:04.033034 12889 raft_consensus.cc:2454] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 1.
I20260812 20:58:04.033237 12329 leader_election.cc:302] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3129e5f1b18d4c579952f8c8209be783, c4abb11d46ad4d28b7b0c7a75abb2997; no voters:
I20260812 20:58:04.033444 13019 raft_consensus.cc:2781] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:04.033514 13019 raft_consensus.cc:686] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 1 LEADER]: Becoming Leader. State: Replica: 3129e5f1b18d4c579952f8c8209be783, State: Running, Role: LEADER
I20260812 20:58:04.033569 13019 consensus_queue.cc:237] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.035745 12180 catalog_manager.cc:5495] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3129e5f1b18d4c579952f8c8209be783 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } health_report { overall_health: UNKNOWN } } }
Aug 12 20:58:04 dist-test-slave-h3ft krb5kdc[12106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:04.086474 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:04.076227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55630 (local address 127.10.30.126:33897)
0812 20:58:04.076285 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:04.076288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:04.076489 (+ 201us) server_negotiation.cc:407] Connection header received
0812 20:58:04.076552 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:04.076554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:04.076569 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:04.076640 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:04.077438 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.078310 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.079375 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.079710 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.079798 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:04.082863 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:04.082865 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:04.082866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:04.082877 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:04.084784 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:04.085321 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:04.085323 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:04.085324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:04.085397 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:04.085604 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:04.085605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:04.085606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:04.085750 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:04.085828 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:04.086015 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 20:58:04.086168 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 20:58:04.086575 13055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:04.076156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33897 (local address 127.0.0.1:55630)
0812 20:58:04.076372 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:04.076385 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:04.076485 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:04.076665 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:04.076667 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:04.077214 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:04.077298 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:04.077303 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.078418 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.078419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:04.079281 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:04.079285 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.079827 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.079828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:04.079919 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:04.080706 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:04.080712 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:04.082725 (+ 2013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:04.084943 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:04.084959 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:04.084962 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:04.085223 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:04.085468 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:04.085469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:04.085470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:04.085538 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:04.085829 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:04.085840 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:04.085911 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 20:58:04.085987 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 20:58:04.086229 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":99,"thread_start_us":133,"threads_started":1}
I20260812 20:58:04.091184 12180 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:55630:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 20:58:04.091722 12180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:04.094491 12857 tablet_service.cc:1467] Processing CreateTablet for tablet dd34a9679c9a4bdca87b794d48de276f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8e065b48b5b144c9a83d2c91702f77ee]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:04.094434 12406 tablet_service.cc:1467] Processing CreateTablet for tablet dd34a9679c9a4bdca87b794d48de276f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8e065b48b5b144c9a83d2c91702f77ee]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:04.094772 12857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd34a9679c9a4bdca87b794d48de276f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:04.094786 12406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd34a9679c9a4bdca87b794d48de276f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:04.096824 13003 tablet_bootstrap.cc:492] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: Bootstrap starting.
I20260812 20:58:04.097020 12625 tablet_service.cc:1467] Processing CreateTablet for tablet dd34a9679c9a4bdca87b794d48de276f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8e065b48b5b144c9a83d2c91702f77ee]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:04.097201 12625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd34a9679c9a4bdca87b794d48de276f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:04.097340 13003 tablet_bootstrap.cc:654] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:04.098290 13003 tablet_bootstrap.cc:492] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: No bootstrap required, opened a new log
I20260812 20:58:04.098388 13003 ts_tablet_manager.cc:1397] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 20:58:04.098618 13003 raft_consensus.cc:348] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.098727 13003 raft_consensus.cc:374] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:04.098766 13003 raft_consensus.cc:729] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4abb11d46ad4d28b7b0c7a75abb2997, State: Initialized, Role: FOLLOWER
I20260812 20:58:04.098832 13003 consensus_queue.cc:260] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.098965 13003 ts_tablet_manager.cc:1428] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:04.099145 13004 tablet_bootstrap.cc:492] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: Bootstrap starting.
I20260812 20:58:04.099254 13002 tablet_bootstrap.cc:492] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: Bootstrap starting.
I20260812 20:58:04.099161 13009 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.099311 13009 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:04.099602 13004 tablet_bootstrap.cc:654] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:04.099753 13002 tablet_bootstrap.cc:654] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:04.100632 13004 tablet_bootstrap.cc:492] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: No bootstrap required, opened a new log
I20260812 20:58:04.100699 13004 ts_tablet_manager.cc:1397] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:04.100862 13004 raft_consensus.cc:348] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.100980 13004 raft_consensus.cc:374] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:04.101011 13004 raft_consensus.cc:729] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3129e5f1b18d4c579952f8c8209be783, State: Initialized, Role: FOLLOWER
I20260812 20:58:04.101061 13004 consensus_queue.cc:260] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.101172 13004 ts_tablet_manager.cc:1428] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:04.101197 13014 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.101301 13014 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:04.101630 13002 tablet_bootstrap.cc:492] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: No bootstrap required, opened a new log
I20260812 20:58:04.101682 13002 ts_tablet_manager.cc:1397] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:04.102070 13002 raft_consensus.cc:348] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.102192 13002 raft_consensus.cc:374] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:04.102214 13002 raft_consensus.cc:729] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7390a0775a9e4c24ad738d031a96a387, State: Initialized, Role: FOLLOWER
I20260812 20:58:04.102284 13002 consensus_queue.cc:260] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.102403 13002 ts_tablet_manager.cc:1428] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:04.102492 13008 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.102599 13008 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:04.230700 13014 raft_consensus.cc:482] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:04.230878 13014 raft_consensus.cc:504] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.231221 13014 leader_election.cc:288] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499), c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641)
I20260812 20:58:04.231597 12663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd34a9679c9a4bdca87b794d48de276f" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7390a0775a9e4c24ad738d031a96a387" is_pre_election: true
I20260812 20:58:04.231599 12889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd34a9679c9a4bdca87b794d48de276f" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" is_pre_election: true
I20260812 20:58:04.231726 12663 raft_consensus.cc:2454] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 0.
I20260812 20:58:04.231750 12889 raft_consensus.cc:2454] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 0.
I20260812 20:58:04.231966 12329 leader_election.cc:302] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3129e5f1b18d4c579952f8c8209be783, c4abb11d46ad4d28b7b0c7a75abb2997; no voters:
I20260812 20:58:04.232134 13014 raft_consensus.cc:2781] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:04.232195 13014 raft_consensus.cc:482] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:04.232216 13014 raft_consensus.cc:3037] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:04.233268 13014 raft_consensus.cc:504] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.233400 13014 leader_election.cc:288] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 election: Requested vote from peers 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499), c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641)
I20260812 20:58:04.233724 12889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd34a9679c9a4bdca87b794d48de276f" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997"
I20260812 20:58:04.233711 12663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd34a9679c9a4bdca87b794d48de276f" candidate_uuid: "3129e5f1b18d4c579952f8c8209be783" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7390a0775a9e4c24ad738d031a96a387"
I20260812 20:58:04.233810 12889 raft_consensus.cc:3037] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:04.233834 12663 raft_consensus.cc:3037] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:04.234710 12889 raft_consensus.cc:2454] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 1.
I20260812 20:58:04.234723 12663 raft_consensus.cc:2454] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3129e5f1b18d4c579952f8c8209be783 in term 1.
I20260812 20:58:04.234938 12329 leader_election.cc:302] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3129e5f1b18d4c579952f8c8209be783, 7390a0775a9e4c24ad738d031a96a387; no voters:
I20260812 20:58:04.235095 13014 raft_consensus.cc:2781] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:04.235158 13014 raft_consensus.cc:686] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [term 1 LEADER]: Becoming Leader. State: Replica: 3129e5f1b18d4c579952f8c8209be783, State: Running, Role: LEADER
I20260812 20:58:04.235219 13014 consensus_queue.cc:237] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } }
I20260812 20:58:04.235572 13019 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: TxnStatusTablet state changed. Reason: New leader 3129e5f1b18d4c579952f8c8209be783. Latest consensus state: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.235677 13019 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:04.236009 13062 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 20:58:04.236052 12179 catalog_manager.cc:5495] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3129e5f1b18d4c579952f8c8209be783 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:04.236222 13062 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 20:58:04.248941 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:04.246075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54696 (local address 127.10.30.65:33609)
0812 20:58:04.246161 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:04.246163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:04.246175 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:04.246237 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:04.246238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:04.246255 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:04.246331 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:04.246514 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.247180 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.248073 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.248312 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.248397 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:04.248608 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:04.248653 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:04.248727 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:04.248804 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 20:58:04.248831 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 20:58:04.248941 13055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:04.245976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:33609 (local address 127.0.0.1:54696)
0812 20:58:04.246071 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:04.246087 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:04.246153 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:04.246343 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:04.246345 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:04.246346 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:04.246424 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:04.246428 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.247270 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.247272 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:04.247960 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:04.247963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.248396 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.248397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:04.248484 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:04.248504 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:04.248729 (+ 225us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:04.248741 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 20:58:04.248789 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 20:58:04.248857 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 20:58:04.250469 12663 raft_consensus.cc:1261] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Refusing update from remote peer 3129e5f1b18d4c579952f8c8209be783: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:04.250515 12889 raft_consensus.cc:1261] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Refusing update from remote peer 3129e5f1b18d4c579952f8c8209be783: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:04.250777 13014 consensus_queue.cc:1035] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:04.250907 13019 consensus_queue.cc:1035] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:04.251525 13009 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: TxnStatusTablet state changed. Reason: New leader 3129e5f1b18d4c579952f8c8209be783. Latest consensus state: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.251631 13009 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:04.251556 13008 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: TxnStatusTablet state changed. Reason: New leader 3129e5f1b18d4c579952f8c8209be783. Latest consensus state: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.251660 13008 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:04.252650 13014 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.252749 13014 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:04.252799 13014 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.252848 13014 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P 3129e5f1b18d4c579952f8c8209be783: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:04.253221 13008 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.253319 13008 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P 7390a0775a9e4c24ad738d031a96a387: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:04.254679 13009 tablet_replica.cc:439] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3129e5f1b18d4c579952f8c8209be783" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3129e5f1b18d4c579952f8c8209be783" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 33609 } } peers { permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 } } peers { permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 } } }
I20260812 20:58:04.254782 13009 tablet_replica.cc:442] T dd34a9679c9a4bdca87b794d48de276f P c4abb11d46ad4d28b7b0c7a75abb2997: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:04.261262 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:04.258300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:55109 (local address 127.10.30.65:33609)
0812 20:58:04.258368 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:04.258371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:04.258502 (+ 131us) server_negotiation.cc:407] Connection header received
0812 20:58:04.258551 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:04.258552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:04.258564 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:04.258626 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:04.258752 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.259549 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.260371 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.260677 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.260752 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:04.260930 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:04.260976 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:04.261031 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:04.261090 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 20:58:04.261141 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":38}
I20260812 20:58:04.261262 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:04.258209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:33609 (local address 127.10.30.65:55109)
0812 20:58:04.258427 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:04.258438 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:04.258501 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:04.258638 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:04.258639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:04.258640 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:04.258695 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:04.258696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.259640 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.259641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:04.260286 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:04.260288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.260772 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.260773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:04.260824 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:04.260842 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:04.261046 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:04.261048 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 20:58:04.261087 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 20:58:04.261167 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":17,"thread_start_us":115,"threads_started":1}
I20260812 20:58:04.264160 12663 raft_consensus.cc:1261] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Refusing update from remote peer 3129e5f1b18d4c579952f8c8209be783: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:04.264160 12889 raft_consensus.cc:1261] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Refusing update from remote peer 3129e5f1b18d4c579952f8c8209be783: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:04.264447 13019 consensus_queue.cc:1035] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7390a0775a9e4c24ad738d031a96a387" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:04.264591 13019 consensus_queue.cc:1035] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4abb11d46ad4d28b7b0c7a75abb2997" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:04.280186 12180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:04.280347 12180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:04.281126 12180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4082d5415e294247b45e4ecec692c835: Sending DeleteTablet for 3 replicas of tablet 3f5b956796b645729898a8511dfc9748
I20260812 20:58:04.281452 12406 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5b956796b645729898a8511dfc9748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:04 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:54680
I20260812 20:58:04.281490 12625 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5b956796b645729898a8511dfc9748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:04 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:58120
I20260812 20:58:04.281579 13039 tablet_replica.cc:330] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: stopping tablet replica
I20260812 20:58:04.281558 12857 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5b956796b645729898a8511dfc9748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:04 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:48194
I20260812 20:58:04.281649 13039 raft_consensus.cc:2229] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:04.281646 13040 tablet_replica.cc:330] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: stopping tablet replica
I20260812 20:58:04.281669 13038 tablet_replica.cc:330] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: stopping tablet replica
I20260812 20:58:04.281708 13040 raft_consensus.cc:2229] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:04.281716 13038 raft_consensus.cc:2229] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:04.281721 13039 raft_consensus.cc:2258] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:04.281750 13040 raft_consensus.cc:2258] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:04.281756 13038 raft_consensus.cc:2258] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:04.282188 13039 ts_tablet_manager.cc:1905] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:04.282202 13040 ts_tablet_manager.cc:1905] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:04.283116 13038 ts_tablet_manager.cc:1905] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:04.284718 13040 ts_tablet_manager.cc:1918] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:04.284715 13039 ts_tablet_manager.cc:1918] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:04.284785 13040 log.cc:1196] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/3f5b956796b645729898a8511dfc9748
I20260812 20:58:04.284786 13039 log.cc:1196] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/3f5b956796b645729898a8511dfc9748
I20260812 20:58:04.285043 13039 ts_tablet_manager.cc:1939] T 3f5b956796b645729898a8511dfc9748 P 3129e5f1b18d4c579952f8c8209be783: Deleting consensus metadata
I20260812 20:58:04.285058 13040 ts_tablet_manager.cc:1939] T 3f5b956796b645729898a8511dfc9748 P 7390a0775a9e4c24ad738d031a96a387: Deleting consensus metadata
I20260812 20:58:04.285425 13038 ts_tablet_manager.cc:1918] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:04.285503 13038 log.cc:1196] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/3f5b956796b645729898a8511dfc9748
I20260812 20:58:04.285558 12154 catalog_manager.cc:4841] TS 7390a0775a9e4c24ad738d031a96a387 (127.10.30.66:42499): tablet 3f5b956796b645729898a8511dfc9748 (table test-table [id=b3b47248ac7a490d8dd1550f92ff2795]) successfully deleted
I20260812 20:58:04.285641 12154 catalog_manager.cc:4841] TS 3129e5f1b18d4c579952f8c8209be783 (127.10.30.65:33609): tablet 3f5b956796b645729898a8511dfc9748 (table test-table [id=b3b47248ac7a490d8dd1550f92ff2795]) successfully deleted
I20260812 20:58:04.285754 13038 ts_tablet_manager.cc:1939] T 3f5b956796b645729898a8511dfc9748 P c4abb11d46ad4d28b7b0c7a75abb2997: Deleting consensus metadata
I20260812 20:58:04.286388 12154 catalog_manager.cc:4841] TS c4abb11d46ad4d28b7b0c7a75abb2997 (127.10.30.67:46641): tablet 3f5b956796b645729898a8511dfc9748 (table test-table [id=b3b47248ac7a490d8dd1550f92ff2795]) successfully deleted
Aug 12 20:58:04 dist-test-slave-h3ft krb5kdc[12106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568283, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:58:04.297508 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:04.286367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54706 (local address 127.10.30.65:33609)
0812 20:58:04.286416 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:04.286419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:04.286609 (+ 190us) server_negotiation.cc:407] Connection header received
0812 20:58:04.286693 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:04.286694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:04.286706 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:04.286753 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:04.287577 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.288105 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.289174 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.289395 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.289551 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:04.293819 (+ 4268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:04.293840 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:04.293841 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:04.293852 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:04.295936 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:04.296377 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:04.296387 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:04.296387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:04.296468 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:04.296722 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:04.296723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:04.296723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:04.296928 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:04.297163 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:04.297243 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 20:58:04.297356 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 20:58:04.297950 12501 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54706
I20260812 20:58:04.306915 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:04.299365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55636 (local address 127.10.30.126:33897)
0812 20:58:04.299426 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:04.299428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:04.299441 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:04.299482 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:04.299483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:04.299495 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:04.299543 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:04.300200 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.300787 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.301906 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:04.302181 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:04.302248 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:04.304001 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:04.304002 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:04.304002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:04.304011 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:04.305743 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:04.306141 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:04.306142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:04.306142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:04.306202 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:04.306409 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:04.306410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:04.306411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:04.306535 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:04.306622 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:04.306757 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 20:58:04.306832 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 20:58:04.307495 12180 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55636
I20260812 20:58:04.308565 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12302
I20260812 20:58:04.327709 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12525
I20260812 20:58:04.348403 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12749
I20260812 20:58:04.368225 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12127
2026-08-12T20:58:04Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2979 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:04 dist-test-slave-h3ft krb5kdc[13098](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:04 dist-test-slave-h3ft krb5kdc[13098](info): set up 2 sockets
Aug 12 20:58:04 dist-test-slave-h3ft krb5kdc[13098](info): commencing operation
krb5kdc: starting...
W20260812 20:58:05.730127 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.326s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:05 dist-test-slave-h3ft krb5kdc[13098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:05.887228 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:45955
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:37791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:45955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:05.986907 13129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:05.987257 13129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:05.987304 13129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:05.988772 13129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:05.988852 13129 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 20:58:05.988873 13129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:05.988896 13129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:05.988927 13129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:05.988955 13129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:05.991034 13129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:45955
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:45955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:05.991716 13129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:05.992130 13129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:05.998440 13144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:05.998458 13141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:05.998456 13142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:05.998806 13129 server_base.cc:1034] running on GCE node
I20260812 20:58:05.999414 13129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:05.999837 13129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:06.001062 13129 hybrid_clock.cc:648] HybridClock initialized: now 1786568286001034 us; error 56 us; skew 500 ppm
Aug 12 20:58:05 dist-test-slave-h3ft krb5kdc[13098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:06.004731 13129 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:06.005486 13129 webserver.cc:460] Webserver started at http://127.10.30.126:37155/ using document root <none> and password file <none>
I20260812 20:58:06.005831 13129 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:06.005920 13129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:06.006114 13129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:06.007680 13129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "f7c03552722d494a893cd735be8838b2"
format_stamp: "Formatted at 2026-08-12 20:58:05 on dist-test-slave-h3ft"
server_key: "b5c7eafb0bde977df576230c735fc0c8"
server_key_iv: "2e1c7cc3bacd96d4bb07f7f5de53e8fc"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.008152 13129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "f7c03552722d494a893cd735be8838b2"
format_stamp: "Formatted at 2026-08-12 20:58:05 on dist-test-slave-h3ft"
server_key: "b5c7eafb0bde977df576230c735fc0c8"
server_key_iv: "2e1c7cc3bacd96d4bb07f7f5de53e8fc"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.010048 13129 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 20:58:06.011379 13152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:06.011602 13129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:06.011737 13129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "f7c03552722d494a893cd735be8838b2"
format_stamp: "Formatted at 2026-08-12 20:58:05 on dist-test-slave-h3ft"
server_key: "b5c7eafb0bde977df576230c735fc0c8"
server_key_iv: "2e1c7cc3bacd96d4bb07f7f5de53e8fc"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.011837 13129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:06.026214 13129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:06.029191 13129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:06.029403 13129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:06.036369 13129 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:45955
I20260812 20:58:06.036480 13250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:45955 every 8 connection(s)
I20260812 20:58:06.036943 13129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:06.037927 13251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:06.041007 13251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: Bootstrap starting.
I20260812 20:58:06.041814 13251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:06.042179 13251 log.cc:824] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:06.043303 13251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: No bootstrap required, opened a new log
I20260812 20:58:06.045424 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13129
I20260812 20:58:06.045549 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:06.045765 10361 external_mini_cluster.cc:1428] Setting key 9fedc0d121f4bd57df5c09265975eae2
I20260812 20:58:06.047438 13251 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c03552722d494a893cd735be8838b2" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45955 } }
I20260812 20:58:06.047739 13251 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:06.047806 13251 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c03552722d494a893cd735be8838b2, State: Initialized, Role: FOLLOWER
I20260812 20:58:06.047969 13251 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c03552722d494a893cd735be8838b2" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45955 } }
I20260812 20:58:06.048058 13251 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:06.048108 13251 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:06.048166 13251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:06.048970 13251 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c03552722d494a893cd735be8838b2" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45955 } }
I20260812 20:58:06.049108 13251 leader_election.cc:302] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7c03552722d494a893cd735be8838b2; no voters:
I20260812 20:58:06.049376 13251 leader_election.cc:288] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:06.049407 13264 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:06.049543 13264 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [term 1 LEADER]: Becoming Leader. State: Replica: f7c03552722d494a893cd735be8838b2, State: Running, Role: LEADER
I20260812 20:58:06.049649 13264 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c03552722d494a893cd735be8838b2" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45955 } }
I20260812 20:58:06.049758 13251 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:06.050112 13264 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7c03552722d494a893cd735be8838b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c03552722d494a893cd735be8838b2" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45955 } } }
I20260812 20:58:06.050194 13264 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:06.050339 13264 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7c03552722d494a893cd735be8838b2. Latest consensus state: current_term: 1 leader_uuid: "f7c03552722d494a893cd735be8838b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c03552722d494a893cd735be8838b2" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45955 } } }
I20260812 20:58:06.050413 13264 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2 [sys.catalog]: This master's current role is: LEADER
W20260812 20:58:06.052047 13297 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 20:58:06.052105 13297 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 20:58:06.052183 13273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:06.052412 13273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:06.054621 13273 catalog_manager.cc:1347] Generated new cluster ID: 663614fd608749c9a9aa408195eb71af
I20260812 20:58:06.054688 13273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:06.060456 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.046569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59142 (local address 127.10.30.126:45955)
0812 20:58:06.046843 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.046856 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.047718 (+ 862us) server_negotiation.cc:407] Connection header received
0812 20:58:06.047907 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.047917 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.047998 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.048200 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.048967 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.050475 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.051638 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.052303 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.052425 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.055840 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.055846 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.055847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.055863 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.058253 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.058802 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.058809 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.058809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.058993 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.059268 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.059269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.059270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.059682 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.059892 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.059989 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.060182 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":146,"threads_started":1}
I20260812 20:58:06.061388 13273 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:06.061928 13273 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:06.068064 13273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: Generated new TSK 0
I20260812 20:58:06.068328 13273 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:06.107499 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45955
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:37791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:06.209954 13308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:06.210269 13308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:06.210318 13308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:06.211710 13308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:06.211786 13308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:06.211824 13308 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 20:58:06.211872 13308 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:06.211913 13308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:06.213553 13308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:45955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:06.213868 13308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:06.214159 13308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:06.220697 13318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:06.220927 13308 server_base.cc:1034] running on GCE node
W20260812 20:58:06.220715 13315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:06.220785 13316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:06.221307 13308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:06.221604 13308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:06.222759 13308 hybrid_clock.cc:648] HybridClock initialized: now 1786568286222739 us; error 42 us; skew 500 ppm
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:06.236953 13308 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:06.237648 13308 webserver.cc:460] Webserver started at http://127.10.30.65:40403/ using document root <none> and password file <none>
I20260812 20:58:06.237922 13308 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:06.237998 13308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:06.238179 13308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:06.239560 13308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "a1856bd93cde42d990c79a0db032493a"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "ac7c80a10c0e7032488d17d3eeba23b8"
server_key_iv: "735dd1f90e2570c26b3dfefc4cae0266"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.239984 13308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "a1856bd93cde42d990c79a0db032493a"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "ac7c80a10c0e7032488d17d3eeba23b8"
server_key_iv: "735dd1f90e2570c26b3dfefc4cae0266"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.241590 13308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:06.242569 13331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:06.242892 13308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:06.243075 13308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "a1856bd93cde42d990c79a0db032493a"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "ac7c80a10c0e7032488d17d3eeba23b8"
server_key_iv: "735dd1f90e2570c26b3dfefc4cae0266"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.243173 13308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:06.258080 13308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:06.261170 13308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:06.261399 13308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:06.262369 13308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:06.262437 13308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:06.262488 13308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:06.262530 13308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:06.271723 13308 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:37443
I20260812 20:58:06.271934 13520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:37443 every 8 connection(s)
I20260812 20:58:06.272245 13308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:58:06.274295 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.262751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:40021 (local address 127.10.30.126:45955)
0812 20:58:06.262824 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.262828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.263159 (+ 331us) server_negotiation.cc:407] Connection header received
0812 20:58:06.263847 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.263849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.263873 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.263922 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.264776 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.265359 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.266650 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.266880 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.266961 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.270728 (+ 3767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.270730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.270730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.270741 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.272730 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.273194 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.273196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.273196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.273272 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.273547 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.273548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.273549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.273708 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.273780 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.274126 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.274217 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 20:58:06.274471 13344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.262752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45955 (local address 127.10.30.65:40021)
0812 20:58:06.262960 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.263043 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.263720 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.264030 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.264035 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.264408 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:06.264663 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.264668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.265484 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.265485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.266547 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.266550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.266969 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.266970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.267160 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.267824 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:06.267838 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:06.270603 (+ 2765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:06.272824 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.272828 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.272831 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.273093 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.273347 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.273347 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.273348 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.273462 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.273778 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:06.273784 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:06.273923 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.274056 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.274224 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":127,"threads_started":1}
I20260812 20:58:06.275046 13521 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45955
I20260812 20:58:06.275162 13521 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:06.275400 13521 heartbeater.cc:511] Master 127.10.30.126:45955 requested a full tablet report, sending...
I20260812 20:58:06.276161 13173 ts_manager.cc:194] Registered new tserver with Master: a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443)
I20260812 20:58:06.276605 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13308
I20260812 20:58:06.276714 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:06.276932 10361 external_mini_cluster.cc:1428] Setting key 8656aa8b26245a1862a73df9c4900992
I20260812 20:58:06.277259 13173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:40021
I20260812 20:58:06.283643 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.276442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:57253 (local address 127.10.30.126:45955)
0812 20:58:06.276496 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.276498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.276569 (+ 71us) server_negotiation.cc:407] Connection header received
0812 20:58:06.276637 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.276638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.276649 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.276701 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.277071 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.277827 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.278907 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.279209 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.279301 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.280641 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.280643 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.280643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.280650 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.282138 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.282598 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.282600 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.282600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.282677 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.282922 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.282923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.282924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.283158 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.283231 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.283463 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.283566 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 20:58:06.283730 13533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.276328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45955 (local address 127.10.30.65:57253)
0812 20:58:06.276511 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.276522 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.276585 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.276703 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.276704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.276910 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:06.276983 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.276985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.277955 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.277956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.278765 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.278768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.279304 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.279304 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.279392 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.279984 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:06.279991 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:06.280549 (+ 558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:06.282233 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.282234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.282235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.282502 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.282755 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.282756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.282756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.282835 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.283237 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:06.283238 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:06.283303 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.283397 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.283550 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":3,"thread_start_us":107,"threads_started":1}
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:06.311676 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45955
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:37791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:06.410485 13538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:06.410796 13538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:06.410847 13538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:06.412283 13538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:06.412371 13538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:06.412411 13538 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 20:58:06.412439 13538 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:06.412473 13538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:06.414387 13538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:45955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:06.414759 13538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:06.415128 13538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:06.425278 13548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:06.425282 13547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:06.425282 13551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:06.435796 13538 server_base.cc:1034] running on GCE node
I20260812 20:58:06.436196 13538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:06.436645 13538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:06.437849 13538 hybrid_clock.cc:648] HybridClock initialized: now 1786568286437830 us; error 41 us; skew 500 ppm
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:06.441121 13538 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:06.441670 13538 webserver.cc:460] Webserver started at http://127.10.30.66:37021/ using document root <none> and password file <none>
I20260812 20:58:06.441929 13538 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:06.441977 13538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:06.442103 13538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:06.443501 13538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "31edd026c7884cec80da3d42738c8f1e"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "0fe48c8b9b96d43c12e6d03004a38102"
server_key_iv: "cb9c63882b98675ca647a183be22de18"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.443889 13538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "31edd026c7884cec80da3d42738c8f1e"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "0fe48c8b9b96d43c12e6d03004a38102"
server_key_iv: "cb9c63882b98675ca647a183be22de18"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.445508 13538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:06.446619 13558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:06.446889 13538 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:06.447005 13538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "31edd026c7884cec80da3d42738c8f1e"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "0fe48c8b9b96d43c12e6d03004a38102"
server_key_iv: "cb9c63882b98675ca647a183be22de18"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.447125 13538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:06.461683 13538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:06.464422 13538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:06.464646 13538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:06.465494 13538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:06.465549 13538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:06.465600 13538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:06.465613 13538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:06.474990 13538 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:35137
I20260812 20:58:06.475168 13738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:35137 every 8 connection(s)
I20260812 20:58:06.475620 13538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:06.478062 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.466037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:55029 (local address 127.10.30.126:45955)
0812 20:58:06.466129 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.466133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.466452 (+ 319us) server_negotiation.cc:407] Connection header received
0812 20:58:06.467534 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.467537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.467552 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.467606 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.468782 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.469430 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.470581 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.470822 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.470919 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.474450 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.474453 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.474453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.474463 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.476519 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.477014 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.477015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.477015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.477085 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.477343 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.477344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.477344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.477491 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.477575 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.477847 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.477982 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:06.478226 13572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.466016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45955 (local address 127.10.30.66:55029)
0812 20:58:06.466261 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.466330 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.467370 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.467716 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.467722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.468245 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:06.468645 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.468656 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.469557 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.469559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.470452 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.470455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.470938 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.470940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.471154 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.472139 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:06.472151 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:06.474299 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:06.476603 (+ 2304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.476608 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.476610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.476854 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.477163 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.477164 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.477165 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.477280 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.477575 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:06.477581 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:06.477722 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.477813 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.477977 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":123,"threads_started":1}
I20260812 20:58:06.478869 13739 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45955
I20260812 20:58:06.478995 13739 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:06.479287 13739 heartbeater.cc:511] Master 127.10.30.126:45955 requested a full tablet report, sending...
I20260812 20:58:06.479796 13173 ts_manager.cc:194] Registered new tserver with Master: 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137)
I20260812 20:58:06.480368 13173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:55029
I20260812 20:58:06.481542 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13538
I20260812 20:58:06.481670 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:06.481910 10361 external_mini_cluster.cc:1428] Setting key 25cea6a1b1bcfe1638ccfa1a2e89ab28
I20260812 20:58:06.487352 13751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.480205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45955 (local address 127.10.30.66:36583)
0812 20:58:06.480358 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.480370 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.480440 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.480596 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.480598 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.480849 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:06.480929 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.480931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.481831 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.481833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.482551 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.482553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.483029 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.483031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.483128 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.483612 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:06.483618 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:06.484093 (+ 475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:06.485984 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.485985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.485986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.486260 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.486493 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.486494 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.486495 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.486573 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.486996 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:06.486997 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:06.487090 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.487162 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.487262 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":95,"threads_started":1}
I20260812 20:58:06.487468 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.480274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:36583 (local address 127.10.30.126:45955)
0812 20:58:06.480324 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.480326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.480448 (+ 122us) server_negotiation.cc:407] Connection header received
0812 20:58:06.480522 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.480522 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.480535 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.480588 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.481019 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.481730 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.482728 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.482916 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.482972 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.484199 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.484200 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.484201 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.484208 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.485912 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.486343 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.486344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.486344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.486422 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.486641 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.486642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.486642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.486925 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.487061 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.487210 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.487302 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:06.518941 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45955
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:37791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:06.619727 13755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:06.620011 13755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:06.620043 13755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:06.621404 13755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:06.621454 13755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:06.621479 13755 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 20:58:06.621490 13755 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:06.621510 13755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:06.623369 13755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:45955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:06.623700 13755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:06.624007 13755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:06.630218 13765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:06.630242 13768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:06.630230 13763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:06.630682 13755 server_base.cc:1034] running on GCE node
I20260812 20:58:06.630955 13755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:06.631289 13755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:06.632453 13755 hybrid_clock.cc:648] HybridClock initialized: now 1786568286632418 us; error 47 us; skew 500 ppm
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:06.635761 13755 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:06.636261 13755 webserver.cc:460] Webserver started at http://127.10.30.67:38041/ using document root <none> and password file <none>
I20260812 20:58:06.636574 13755 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:06.636653 13755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:06.636832 13755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:06.638101 13755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "4ce1205163984487bdfe08d98964d061"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "0091e16386e3c06eb363a3cc47fbec37"
server_key_iv: "e0ebc24ad12524b465f7657a5027286b"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.638551 13755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "4ce1205163984487bdfe08d98964d061"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "0091e16386e3c06eb363a3cc47fbec37"
server_key_iv: "e0ebc24ad12524b465f7657a5027286b"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.640693 13755 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:06.641697 13784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:06.642089 13755 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:06.642215 13755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "4ce1205163984487bdfe08d98964d061"
format_stamp: "Formatted at 2026-08-12 20:58:06 on dist-test-slave-h3ft"
server_key: "0091e16386e3c06eb363a3cc47fbec37"
server_key_iv: "e0ebc24ad12524b465f7657a5027286b"
server_key_version: "encryptionkey@0"
I20260812 20:58:06.642315 13755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:06.653913 13755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:06.656661 13755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:06.656860 13755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:06.657541 13755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:06.657610 13755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:06.657668 13755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:06.657693 13755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:06.666924 13755 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:42911
I20260812 20:58:06.667083 13981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:42911 every 8 connection(s)
I20260812 20:58:06.667465 13755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:06.671068 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.658251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:59185 (local address 127.10.30.126:45955)
0812 20:58:06.658326 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.658330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.658586 (+ 256us) server_negotiation.cc:407] Connection header received
0812 20:58:06.659333 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.659335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.659354 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.659450 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.660662 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.661579 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.663403 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.663737 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.663828 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.667372 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.667375 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.667375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.667388 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.669106 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.669688 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.669689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.669690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.669763 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.670147 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.670149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.670149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.670323 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.670391 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.670777 (+ 386us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.670875 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 20:58:06.671200 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.658197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45955 (local address 127.10.30.67:59185)
0812 20:58:06.658417 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.658466 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.659208 (+ 742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.659601 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.659607 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.660114 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:06.660478 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.660507 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.661707 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.661709 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.663286 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.663289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.663869 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.663871 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.664087 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.664767 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:06.664781 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:06.667231 (+ 2450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:06.669239 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.669248 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.669251 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.669542 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.669864 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.669865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.669866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.670021 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.670396 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:06.670402 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:06.670573 (+ 171us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.670671 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.670853 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":132,"threads_started":1}
I20260812 20:58:06.672037 13983 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45955
I20260812 20:58:06.672183 13983 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:06.672435 13983 heartbeater.cc:511] Master 127.10.30.126:45955 requested a full tablet report, sending...
I20260812 20:58:06.672976 13174 ts_manager.cc:194] Registered new tserver with Master: 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911)
I20260812 20:58:06.673527 13174 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:59185
I20260812 20:58:06.677743 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13755
I20260812 20:58:06.677855 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:06.678126 10361 external_mini_cluster.cc:1428] Setting key 2abbcb49acc9ea44994989e66dd1c61d
I20260812 20:58:06.679491 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:58:06.681756 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.673572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:51477 (local address 127.10.30.126:45955)
0812 20:58:06.673648 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.673651 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.673819 (+ 168us) server_negotiation.cc:407] Connection header received
0812 20:58:06.673878 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.673879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.673892 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.673979 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.674586 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.675428 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.676374 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.676599 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.676664 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.678028 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.678030 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.678030 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.678041 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.680253 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.680662 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.680663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.680663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.680738 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.680964 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.680965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.680965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.681203 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.681319 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.681527 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.681638 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 20:58:06.681777 13992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.673495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45955 (local address 127.10.30.67:51477)
0812 20:58:06.673722 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.673737 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.673819 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.674008 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.674009 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.674318 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:06.674399 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.674432 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.675584 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.675586 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.676281 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.676284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.676720 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.676721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.676798 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.677394 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:06.677399 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:06.677878 (+ 479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:06.680346 (+ 2468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.680348 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.680348 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.680568 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.680819 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.680820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.680821 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.680897 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.681317 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:06.681319 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:06.681410 (+ 91us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.681495 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.681641 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":141,"threads_started":1}
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:06.710630 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.702091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59148 (local address 127.10.30.126:45955)
0812 20:58:06.702180 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.702183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.702195 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:06.702239 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.702240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.702251 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.702323 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.703050 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.703613 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.704461 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.704685 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.704771 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.707602 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.707605 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.707606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.707625 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.709267 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.709701 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.709702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.709702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.709772 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.709988 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.709989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.709989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.710138 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.710261 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.710385 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.710488 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:06.713208 13174 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:06.715474 13174 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:06.723712 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.718765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35137 (local address 127.0.0.1:52342)
0812 20:58:06.718963 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.719041 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.719132 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.719758 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.719762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.719766 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:06.719881 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.719884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.721309 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.721331 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.722427 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.722429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.723405 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.723407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.723479 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.723483 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.723548 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.723623 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":5,"thread_start_us":61,"threads_started":1}
I20260812 20:58:06.723701 14027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.719132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48564 (local address 127.10.30.67:42911)
0812 20:58:06.719390 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.719397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.719454 (+ 57us) server_negotiation.cc:407] Connection header received
0812 20:58:06.719599 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.719602 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.719621 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.719708 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:06.719981 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.721210 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.722438 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.723146 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.723239 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.723324 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.723489 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.723558 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":112,"threads_started":1}
I20260812 20:58:06.723742 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.718921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52342 (local address 127.10.30.66:35137)
0812 20:58:06.719517 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.719521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.719533 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:06.719586 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.719589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.719610 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.719751 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:06.720068 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.721217 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.722519 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.723335 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.723409 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.723469 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.723563 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.723612 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":235,"threads_started":1}
I20260812 20:58:06.724045 14020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.718773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42911 (local address 127.0.0.1:48564)
0812 20:58:06.719289 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.719382 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.719485 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.719806 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.719807 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.719809 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:06.719881 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.719884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.721343 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.721344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.722261 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.722264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.723238 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.723240 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.723333 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.723350 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.723885 (+ 535us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.723948 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":8,"thread_start_us":132,"threads_started":1}
I20260812 20:58:06.724244 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.718772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:37443 (local address 127.0.0.1:32906)
0812 20:58:06.719257 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.719268 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.719314 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.719862 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.719863 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.719866 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:06.719945 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.719947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.720894 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.720895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.722239 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.722243 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.723435 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.723436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.723514 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.723518 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.723571 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.723626 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":1,"thread_start_us":120,"threads_started":1}
I20260812 20:58:06.724502 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.719225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32906 (local address 127.10.30.65:37443)
0812 20:58:06.719604 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.719613 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.719624 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:06.719677 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.719680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.719698 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.719781 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:06.720039 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.720795 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.722359 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.723234 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.723313 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.723383 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.724035 (+ 652us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.724093 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":104,"threads_started":1}
I20260812 20:58:06.724864 13873 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a75779e224bebbc6cce301c58214a (DEFAULT_TABLE table=test-table [id=544377db6dc24c62ab59d1ba2c5169e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:06.724880 13632 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a75779e224bebbc6cce301c58214a (DEFAULT_TABLE table=test-table [id=544377db6dc24c62ab59d1ba2c5169e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:06.725271 13632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a75779e224bebbc6cce301c58214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:06.725272 13873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a75779e224bebbc6cce301c58214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:06.727268 13412 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a75779e224bebbc6cce301c58214a (DEFAULT_TABLE table=test-table [id=544377db6dc24c62ab59d1ba2c5169e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:06.727761 13412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a75779e224bebbc6cce301c58214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:06.729085 14031 tablet_bootstrap.cc:492] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Bootstrap starting.
I20260812 20:58:06.729830 14031 tablet_bootstrap.cc:654] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:06.730239 14031 log.cc:824] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:06.731323 14031 tablet_bootstrap.cc:492] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: No bootstrap required, opened a new log
I20260812 20:58:06.731410 14031 ts_tablet_manager.cc:1397] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:06.731565 14033 tablet_bootstrap.cc:492] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Bootstrap starting.
I20260812 20:58:06.732146 14035 tablet_bootstrap.cc:492] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Bootstrap starting.
I20260812 20:58:06.732722 14033 tablet_bootstrap.cc:654] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:06.733047 14035 tablet_bootstrap.cc:654] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:06.733168 14033 log.cc:824] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:06.733450 14035 log.cc:824] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:06.734048 14031 raft_consensus.cc:348] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.734270 14031 raft_consensus.cc:374] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:06.734313 14031 raft_consensus.cc:729] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31edd026c7884cec80da3d42738c8f1e, State: Initialized, Role: FOLLOWER
I20260812 20:58:06.734436 14035 tablet_bootstrap.cc:492] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: No bootstrap required, opened a new log
I20260812 20:58:06.734522 14035 ts_tablet_manager.cc:1397] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:06.734500 14031 consensus_queue.cc:260] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.734882 14031 ts_tablet_manager.cc:1428] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 20:58:06.735100 13739 heartbeater.cc:503] Master 127.10.30.126:45955 was elected leader, sending a full tablet report...
I20260812 20:58:06.735873 14033 tablet_bootstrap.cc:492] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: No bootstrap required, opened a new log
I20260812 20:58:06.735970 14033 ts_tablet_manager.cc:1397] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 20:58:06.736918 14035 raft_consensus.cc:348] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.737114 14035 raft_consensus.cc:374] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:06.737140 14035 raft_consensus.cc:729] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1856bd93cde42d990c79a0db032493a, State: Initialized, Role: FOLLOWER
I20260812 20:58:06.737277 14035 consensus_queue.cc:260] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.737630 14035 ts_tablet_manager.cc:1428] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 20:58:06.737673 13521 heartbeater.cc:503] Master 127.10.30.126:45955 was elected leader, sending a full tablet report...
I20260812 20:58:06.738559 14033 raft_consensus.cc:348] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.738770 14033 raft_consensus.cc:374] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:06.738829 14033 raft_consensus.cc:729] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce1205163984487bdfe08d98964d061, State: Initialized, Role: FOLLOWER
I20260812 20:58:06.738979 14033 consensus_queue.cc:260] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.739410 14033 ts_tablet_manager.cc:1428] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 20:58:06.739468 13983 heartbeater.cc:503] Master 127.10.30.126:45955 was elected leader, sending a full tablet report...
W20260812 20:58:06.773301 13522 tablet.cc:2369] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:06.821727 14040 raft_consensus.cc:482] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:06.821928 14040 raft_consensus.cc:504] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.822355 14040 leader_election.cc:288] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137), a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443)
I20260812 20:58:06.825896 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.822803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:48875 (local address 127.10.30.65:37443)
0812 20:58:06.822901 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.822904 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.822914 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:06.822960 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.822961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.822971 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.823122 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:06.823323 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.823952 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.825017 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.825454 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.825517 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.825528 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.825742 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.825796 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 20:58:06.825896 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.822787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:48705 (local address 127.10.30.66:35137)
0812 20:58:06.822878 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.822881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.823235 (+ 354us) server_negotiation.cc:407] Connection header received
0812 20:58:06.823275 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.823276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.823290 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.823356 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:06.823536 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.824084 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.825083 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.825471 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.825585 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.825596 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.825768 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.825815 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 20:58:06.825909 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.822665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:37443 (local address 127.10.30.67:48875)
0812 20:58:06.822751 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.822768 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.822848 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.823133 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.823135 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.823137 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:06.823240 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.823243 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.824039 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.824041 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.824915 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.824918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.825556 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.825557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.825654 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.825659 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.825713 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.825787 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 20:58:06.825930 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.822665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35137 (local address 127.10.30.67:48705)
0812 20:58:06.823146 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.823156 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.823223 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.823372 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.823373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.823375 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:06.823452 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.823454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.824170 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.824171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.824982 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.824985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.825602 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.825603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.825671 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.825675 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.825750 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.825794 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":249,"thread_start_us":164,"threads_started":1}
I20260812 20:58:06.826499 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a75779e224bebbc6cce301c58214a" candidate_uuid: "4ce1205163984487bdfe08d98964d061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1856bd93cde42d990c79a0db032493a" is_pre_election: true
I20260812 20:58:06.826565 13665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a75779e224bebbc6cce301c58214a" candidate_uuid: "4ce1205163984487bdfe08d98964d061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31edd026c7884cec80da3d42738c8f1e" is_pre_election: true
I20260812 20:58:06.826750 13665 raft_consensus.cc:2454] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ce1205163984487bdfe08d98964d061 in term 0.
I20260812 20:58:06.826750 13445 raft_consensus.cc:2454] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ce1205163984487bdfe08d98964d061 in term 0.
I20260812 20:58:06.827117 13787 leader_election.cc:302] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31edd026c7884cec80da3d42738c8f1e, 4ce1205163984487bdfe08d98964d061; no voters:
I20260812 20:58:06.827373 14040 raft_consensus.cc:2781] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:06.827445 14040 raft_consensus.cc:482] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:06.827472 14040 raft_consensus.cc:3037] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:06.828596 14040 raft_consensus.cc:504] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.828791 14040 leader_election.cc:288] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [CANDIDATE]: Term 1 election: Requested vote from peers 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137), a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443)
I20260812 20:58:06.829005 13665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a75779e224bebbc6cce301c58214a" candidate_uuid: "4ce1205163984487bdfe08d98964d061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31edd026c7884cec80da3d42738c8f1e"
I20260812 20:58:06.829006 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a75779e224bebbc6cce301c58214a" candidate_uuid: "4ce1205163984487bdfe08d98964d061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1856bd93cde42d990c79a0db032493a"
I20260812 20:58:06.829097 13665 raft_consensus.cc:3037] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:06.829146 13445 raft_consensus.cc:3037] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:06.830127 13445 raft_consensus.cc:2454] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ce1205163984487bdfe08d98964d061 in term 1.
I20260812 20:58:06.830149 13665 raft_consensus.cc:2454] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ce1205163984487bdfe08d98964d061 in term 1.
I20260812 20:58:06.830935 13786 leader_election.cc:302] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ce1205163984487bdfe08d98964d061, a1856bd93cde42d990c79a0db032493a; no voters:
I20260812 20:58:06.831122 14040 raft_consensus.cc:2781] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:06.831295 14040 raft_consensus.cc:686] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 1 LEADER]: Becoming Leader. State: Replica: 4ce1205163984487bdfe08d98964d061, State: Running, Role: LEADER
I20260812 20:58:06.831422 14040 consensus_queue.cc:237] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.832615 13174 catalog_manager.cc:5495] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ce1205163984487bdfe08d98964d061 (127.10.30.67). New cstate: current_term: 1 leader_uuid: "4ce1205163984487bdfe08d98964d061" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } health_report { overall_health: HEALTHY } } }
Aug 12 20:58:06 dist-test-slave-h3ft krb5kdc[13098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:06.877398 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.868277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59154 (local address 127.10.30.126:45955)
0812 20:58:06.868440 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:06.868443 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:06.868595 (+ 152us) server_negotiation.cc:407] Connection header received
0812 20:58:06.868687 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:06.868688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:06.868707 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:06.868777 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:06.869525 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.870118 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.870900 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.871168 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.871257 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.874193 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:06.874195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:06.874196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:06.874204 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:06.875854 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.876392 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.876394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.876395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.876467 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:06.876677 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:06.876678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:06.876679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:06.876845 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:06.876929 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:06.877107 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 20:58:06.877245 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":114}
I20260812 20:58:06.877449 14055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:06.868187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45955 (local address 127.0.0.1:59154)
0812 20:58:06.868487 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:06.868500 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:06.868622 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:06.868782 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:06.868783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:06.869322 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:06.869390 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.869396 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.870224 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.870226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.870807 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:06.870809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:06.871259 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:06.871260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:06.871320 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:06.872048 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:06.872053 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:06.874076 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:06.876042 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.876053 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.876057 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.876288 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.876539 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:06.876540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:06.876540 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:06.876611 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:06.876916 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:06.876926 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:06.876983 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 20:58:06.877069 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 20:58:06.877308 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":102,"thread_start_us":152,"threads_started":1}
I20260812 20:58:06.880559 13174 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:59154:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 20:58:06.880868 13174 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:06.882969 13412 tablet_service.cc:1467] Processing CreateTablet for tablet 5d06ded144ab481682bd9729de24b4d1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d8620fee9d74e0494042131cc3ad5e5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:06.883044 13873 tablet_service.cc:1467] Processing CreateTablet for tablet 5d06ded144ab481682bd9729de24b4d1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d8620fee9d74e0494042131cc3ad5e5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:06.882962 13632 tablet_service.cc:1467] Processing CreateTablet for tablet 5d06ded144ab481682bd9729de24b4d1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d8620fee9d74e0494042131cc3ad5e5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:06.883253 13873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d06ded144ab481682bd9729de24b4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:06.883253 13412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d06ded144ab481682bd9729de24b4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:06.883255 13632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d06ded144ab481682bd9729de24b4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:06.885058 14031 tablet_bootstrap.cc:492] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: Bootstrap starting.
I20260812 20:58:06.885181 14035 tablet_bootstrap.cc:492] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: Bootstrap starting.
I20260812 20:58:06.885407 14033 tablet_bootstrap.cc:492] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: Bootstrap starting.
I20260812 20:58:06.885771 14035 tablet_bootstrap.cc:654] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:06.885921 14033 tablet_bootstrap.cc:654] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:06.886014 14031 tablet_bootstrap.cc:654] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:06.886633 14035 tablet_bootstrap.cc:492] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: No bootstrap required, opened a new log
I20260812 20:58:06.886698 14035 ts_tablet_manager.cc:1397] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:06.886927 14035 raft_consensus.cc:348] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.887059 14035 raft_consensus.cc:374] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:06.887053 14031 tablet_bootstrap.cc:492] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: No bootstrap required, opened a new log
I20260812 20:58:06.887086 14035 raft_consensus.cc:729] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1856bd93cde42d990c79a0db032493a, State: Initialized, Role: FOLLOWER
I20260812 20:58:06.887110 14031 ts_tablet_manager.cc:1397] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 20:58:06.887171 14035 consensus_queue.cc:260] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.887331 14035 ts_tablet_manager.cc:1428] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:06.887338 14033 tablet_bootstrap.cc:492] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: No bootstrap required, opened a new log
I20260812 20:58:06.887317 14031 raft_consensus.cc:348] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.887391 14033 ts_tablet_manager.cc:1397] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:06.887399 14031 raft_consensus.cc:374] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:06.887422 14031 raft_consensus.cc:729] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31edd026c7884cec80da3d42738c8f1e, State: Initialized, Role: FOLLOWER
I20260812 20:58:06.887408 14039 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:06.887478 14031 consensus_queue.cc:260] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.887519 14039 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:06.887607 14031 ts_tablet_manager.cc:1428] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:06.887593 14033 raft_consensus.cc:348] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.887678 14033 raft_consensus.cc:374] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:06.887703 14033 raft_consensus.cc:729] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce1205163984487bdfe08d98964d061, State: Initialized, Role: FOLLOWER
I20260812 20:58:06.887753 14033 consensus_queue.cc:260] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:06.887707 14038 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:06.887804 14038 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:06.887862 14033 ts_tablet_manager.cc:1428] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 20:58:06.888031 14040 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:06.888145 14040 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 20:58:06.918332 13984 tablet.cc:2369] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 20:58:06.976588 13740 tablet.cc:2369] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:07.014935 14039 raft_consensus.cc:482] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:07.015169 14039 raft_consensus.cc:504] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.015691 14039 leader_election.cc:288] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137), 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911)
I20260812 20:58:07.020398 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.016103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:54603 (local address 127.10.30.66:35137)
0812 20:58:07.016202 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.016205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.016276 (+ 71us) server_negotiation.cc:407] Connection header received
0812 20:58:07.016392 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.016393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.016403 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.016469 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:07.016746 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.017587 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.019385 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.020004 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.020076 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.020085 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.020260 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.020309 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 20:58:07.020398 14027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.016191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:35597 (local address 127.10.30.67:42911)
0812 20:58:07.016245 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.016247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.016292 (+ 45us) server_negotiation.cc:407] Connection header received
0812 20:58:07.016389 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.016391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.016403 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.016469 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:07.016751 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.017564 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.019315 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.019934 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.020070 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.020083 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.020259 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.020304 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 20:58:07.020447 14064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.016024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42911 (local address 127.10.30.65:35597)
0812 20:58:07.016230 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.016239 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.016298 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.016493 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.016495 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.016498 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:07.016654 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.016658 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.017690 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.017692 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.019198 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.019205 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.020070 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.020072 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.020168 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.020176 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.020239 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.020304 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":25,"spinlock_wait_cycles":20352,"thread_start_us":79,"threads_started":1}
I20260812 20:58:07.020457 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.016005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35137 (local address 127.10.30.65:54603)
0812 20:58:07.016186 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.016200 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.016298 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.016493 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.016495 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.016498 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:07.016654 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.016658 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.017690 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.017717 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.019286 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.019288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.020085 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.020086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.020168 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.020174 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.020239 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.020304 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":32,"thread_start_us":102,"threads_started":1}
I20260812 20:58:07.020977 13665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d06ded144ab481682bd9729de24b4d1" candidate_uuid: "a1856bd93cde42d990c79a0db032493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31edd026c7884cec80da3d42738c8f1e" is_pre_election: true
I20260812 20:58:07.020965 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d06ded144ab481682bd9729de24b4d1" candidate_uuid: "a1856bd93cde42d990c79a0db032493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ce1205163984487bdfe08d98964d061" is_pre_election: true
I20260812 20:58:07.021116 13665 raft_consensus.cc:2454] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1856bd93cde42d990c79a0db032493a in term 0.
I20260812 20:58:07.021153 13908 raft_consensus.cc:2454] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1856bd93cde42d990c79a0db032493a in term 0.
I20260812 20:58:07.021343 13334 leader_election.cc:302] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31edd026c7884cec80da3d42738c8f1e, a1856bd93cde42d990c79a0db032493a; no voters:
I20260812 20:58:07.021545 14039 raft_consensus.cc:2781] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:07.021607 14039 raft_consensus.cc:482] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:07.021634 14039 raft_consensus.cc:3037] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:07.022605 14039 raft_consensus.cc:504] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.022800 14039 leader_election.cc:288] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [CANDIDATE]: Term 1 election: Requested vote from peers 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137), 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911)
I20260812 20:58:07.023053 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d06ded144ab481682bd9729de24b4d1" candidate_uuid: "a1856bd93cde42d990c79a0db032493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ce1205163984487bdfe08d98964d061"
I20260812 20:58:07.023059 13665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d06ded144ab481682bd9729de24b4d1" candidate_uuid: "a1856bd93cde42d990c79a0db032493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31edd026c7884cec80da3d42738c8f1e"
I20260812 20:58:07.023154 13665 raft_consensus.cc:3037] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:07.023154 13908 raft_consensus.cc:3037] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:07.024158 13665 raft_consensus.cc:2454] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1856bd93cde42d990c79a0db032493a in term 1.
I20260812 20:58:07.024179 13908 raft_consensus.cc:2454] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1856bd93cde42d990c79a0db032493a in term 1.
I20260812 20:58:07.024408 13334 leader_election.cc:302] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31edd026c7884cec80da3d42738c8f1e, a1856bd93cde42d990c79a0db032493a; no voters:
I20260812 20:58:07.024554 14039 raft_consensus.cc:2781] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:07.024747 14039 raft_consensus.cc:686] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [term 1 LEADER]: Becoming Leader. State: Replica: a1856bd93cde42d990c79a0db032493a, State: Running, Role: LEADER
I20260812 20:58:07.024884 14039 consensus_queue.cc:237] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.025483 14065 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: TxnStatusTablet state changed. Reason: New leader a1856bd93cde42d990c79a0db032493a. Latest consensus state: current_term: 1 leader_uuid: "a1856bd93cde42d990c79a0db032493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:07.025597 14065 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:07.025799 14067 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 20:58:07.025930 14067 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 20:58:07.025986 13171 catalog_manager.cc:5495] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1856bd93cde42d990c79a0db032493a (127.10.30.65). New cstate: current_term: 1 leader_uuid: "a1856bd93cde42d990c79a0db032493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:07.037798 14055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.034431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:37443 (local address 127.0.0.1:32920)
0812 20:58:07.034528 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.034543 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.034595 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.034966 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.034967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.034968 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:07.035074 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.035078 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.035879 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.035880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.036725 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.036729 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.037158 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.037159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.037236 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.037254 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.037594 (+ 340us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.037605 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.037659 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.037725 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 20:58:07.037781 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.034713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32920 (local address 127.10.30.65:37443)
0812 20:58:07.034787 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.034789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.034798 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:07.034844 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.034845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.034868 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.034954 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:07.035170 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.035775 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.036826 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.037066 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.037151 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.037361 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.037513 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.037607 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.037665 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.037689 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 20:58:07.041424 13908 raft_consensus.cc:1261] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Refusing update from remote peer a1856bd93cde42d990c79a0db032493a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:07.041428 13665 raft_consensus.cc:1261] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Refusing update from remote peer a1856bd93cde42d990c79a0db032493a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:07.041839 14039 consensus_queue.cc:1035] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:07.041986 14065 consensus_queue.cc:1035] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:07.043609 14038 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: TxnStatusTablet state changed. Reason: New leader a1856bd93cde42d990c79a0db032493a. Latest consensus state: current_term: 1 leader_uuid: "a1856bd93cde42d990c79a0db032493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:07.043723 14038 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:07.043893 14040 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: TxnStatusTablet state changed. Reason: New leader a1856bd93cde42d990c79a0db032493a. Latest consensus state: current_term: 1 leader_uuid: "a1856bd93cde42d990c79a0db032493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:07.043998 14040 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:07.045606 14039 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a1856bd93cde42d990c79a0db032493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:07.045720 14039 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:07.045696 14038 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a1856bd93cde42d990c79a0db032493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:07.045768 14039 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a1856bd93cde42d990c79a0db032493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:07.045790 14038 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P 31edd026c7884cec80da3d42738c8f1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:07.045806 14039 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P a1856bd93cde42d990c79a0db032493a: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:07.046729 14040 tablet_replica.cc:439] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a1856bd93cde42d990c79a0db032493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } } }
I20260812 20:58:07.046869 14040 tablet_replica.cc:442] T 5d06ded144ab481682bd9729de24b4d1 P 4ce1205163984487bdfe08d98964d061: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:07.047600 14070 mvcc.cc:205] Tried to move back new op lower bound from 7317783703717793792 to 7317783703654486016. Current Snapshot: MvccSnapshot[applied={T|T < 7317783703717793792}]
I20260812 20:58:07.047757 14072 mvcc.cc:205] Tried to move back new op lower bound from 7317783703717793792 to 7317783703654486016. Current Snapshot: MvccSnapshot[applied={T|T < 7317783703717793792 or (T in {7317783703717793792})}]
I20260812 20:58:07.047895 14073 mvcc.cc:205] Tried to move back new op lower bound from 7317783703717793792 to 7317783703654486016. Current Snapshot: MvccSnapshot[applied={T|T < 7317783703717793792 or (T in {7317783703717793792})}]
I20260812 20:58:07.056589 14027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.052882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48568 (local address 127.10.30.67:42911)
0812 20:58:07.052955 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.052957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.052966 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:07.053017 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.053018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.053046 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.053143 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:07.053256 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.054109 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.055029 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.055361 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.055446 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.055793 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.056075 (+ 282us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.056187 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.056429 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.056475 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 20:58:07.063230 13992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.060205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:37443 (local address 127.10.30.67:50197)
0812 20:58:07.060298 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.060312 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.060412 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.060600 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.060601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.060602 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:07.060701 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.060703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.061453 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.061454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.062170 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.062172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.062617 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.062618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.062707 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.062726 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.062987 (+ 261us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.062991 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.063078 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.063136 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 20:58:07.063230 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.060308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:50197 (local address 127.10.30.65:37443)
0812 20:58:07.060389 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.060392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.060405 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:07.060480 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.060481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.060496 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.060594 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:07.060786 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.061357 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.062273 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.062511 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.062615 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.062871 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.062915 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.062985 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.063084 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.063113 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 20:58:07.066545 13665 raft_consensus.cc:1261] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Refusing update from remote peer 4ce1205163984487bdfe08d98964d061: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:07.066773 13445 raft_consensus.cc:1261] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Refusing update from remote peer 4ce1205163984487bdfe08d98964d061: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:07.067037 14043 consensus_queue.cc:1035] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:07.067229 14040 consensus_queue.cc:1035] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:07.078644 14027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.075139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:37263 (local address 127.10.30.67:42911)
0812 20:58:07.075293 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.075296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.075370 (+ 74us) server_negotiation.cc:407] Connection header received
0812 20:58:07.075434 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.075435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.075448 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.075523 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:07.075712 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.076591 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.077722 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.078055 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.078136 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.078334 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.078380 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.078435 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.078507 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.078538 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260812 20:58:07.078651 14094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.075085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42911 (local address 127.10.30.65:37263)
0812 20:58:07.075308 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.075320 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.075384 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.075524 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.075525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.075527 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:07.075636 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.075638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.076755 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.076756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.077629 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.077634 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.078148 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.078149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.078216 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.078241 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.078457 (+ 216us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.078460 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.078497 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.078546 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":132,"threads_started":1}
I20260812 20:58:07.093358 13173 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:07.093555 13173 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:07.094664 13173 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: Sending DeleteTablet for 3 replicas of tablet 0f8a75779e224bebbc6cce301c58214a
I20260812 20:58:07.095307 13632 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a75779e224bebbc6cce301c58214a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:07 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:52342
I20260812 20:58:07.095407 13873 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a75779e224bebbc6cce301c58214a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:07 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:48564
I20260812 20:58:07.095811 13412 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a75779e224bebbc6cce301c58214a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:07 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:32906
I20260812 20:58:07.096122 14105 tablet_replica.cc:330] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: stopping tablet replica
I20260812 20:58:07.096112 13173 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 20:58:07.096282 14105 raft_consensus.cc:2229] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 20:58:07.096328 13173 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:07.096381 14105 raft_consensus.cc:2258] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:07.097105 14105 ts_tablet_manager.cc:1905] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:07.098090 14104 tablet_replica.cc:330] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: stopping tablet replica
I20260812 20:58:07.098336 14104 raft_consensus.cc:2229] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:07.098583 14104 raft_consensus.cc:2258] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:07.098726 13412 tablet_service.cc:1467] Processing CreateTablet for tablet 63eb12a90fac45dfbac248d39d985390 (DEFAULT_TABLE table=test-table [id=93d2ceba754749cf9c3fe2d49a24c00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:07.098719 13873 tablet_service.cc:1467] Processing CreateTablet for tablet 63eb12a90fac45dfbac248d39d985390 (DEFAULT_TABLE table=test-table [id=93d2ceba754749cf9c3fe2d49a24c00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:07.098917 13412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63eb12a90fac45dfbac248d39d985390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:07.098919 13873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63eb12a90fac45dfbac248d39d985390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:07.099697 14105 ts_tablet_manager.cc:1918] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:07.099792 14105 log.cc:1196] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/0f8a75779e224bebbc6cce301c58214a
I20260812 20:58:07.100186 14105 ts_tablet_manager.cc:1939] T 0f8a75779e224bebbc6cce301c58214a P a1856bd93cde42d990c79a0db032493a: Deleting consensus metadata
I20260812 20:58:07.100463 14035 tablet_bootstrap.cc:492] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: Bootstrap starting.
I20260812 20:58:07.100585 13632 tablet_service.cc:1467] Processing CreateTablet for tablet 63eb12a90fac45dfbac248d39d985390 (DEFAULT_TABLE table=test-table [id=93d2ceba754749cf9c3fe2d49a24c00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:07.100754 13632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63eb12a90fac45dfbac248d39d985390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:07.100958 14035 tablet_bootstrap.cc:654] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:07.101046 14033 tablet_bootstrap.cc:492] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: Bootstrap starting.
I20260812 20:58:07.101617 14033 tablet_bootstrap.cc:654] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:07.102556 14035 tablet_bootstrap.cc:492] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: No bootstrap required, opened a new log
I20260812 20:58:07.102604 14035 ts_tablet_manager.cc:1397] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:07.102694 14031 tablet_bootstrap.cc:492] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: Bootstrap starting.
I20260812 20:58:07.102798 14035 raft_consensus.cc:348] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.102892 14035 raft_consensus.cc:374] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:07.102918 14035 raft_consensus.cc:729] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1856bd93cde42d990c79a0db032493a, State: Initialized, Role: FOLLOWER
I20260812 20:58:07.102969 14035 consensus_queue.cc:260] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.103116 14035 ts_tablet_manager.cc:1428] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 20:58:07.103264 14031 tablet_bootstrap.cc:654] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:07.103497 14103 tablet_replica.cc:330] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: stopping tablet replica
I20260812 20:58:07.103678 14103 raft_consensus.cc:2229] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:07.103770 14103 raft_consensus.cc:2258] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:07.104113 13156 catalog_manager.cc:4841] TS a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443): tablet 0f8a75779e224bebbc6cce301c58214a (table test-table [id=544377db6dc24c62ab59d1ba2c5169e0]) successfully deleted
I20260812 20:58:07.104279 14031 tablet_bootstrap.cc:492] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: No bootstrap required, opened a new log
I20260812 20:58:07.104333 14031 ts_tablet_manager.cc:1397] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:07.104519 14031 raft_consensus.cc:348] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.104619 14031 raft_consensus.cc:374] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:07.104645 14031 raft_consensus.cc:729] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31edd026c7884cec80da3d42738c8f1e, State: Initialized, Role: FOLLOWER
I20260812 20:58:07.104694 14031 consensus_queue.cc:260] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.104804 14031 ts_tablet_manager.cc:1428] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:07.105103 14104 ts_tablet_manager.cc:1905] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:07.105439 14103 ts_tablet_manager.cc:1905] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:07.107872 14033 tablet_bootstrap.cc:492] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: No bootstrap required, opened a new log
I20260812 20:58:07.107961 14033 ts_tablet_manager.cc:1397] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260812 20:58:07.108186 14033 raft_consensus.cc:348] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.108304 14033 raft_consensus.cc:374] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:07.108337 14033 raft_consensus.cc:729] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce1205163984487bdfe08d98964d061, State: Initialized, Role: FOLLOWER
I20260812 20:58:07.108395 14033 consensus_queue.cc:260] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.108525 14033 ts_tablet_manager.cc:1428] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:07.108633 14104 ts_tablet_manager.cc:1918] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:07.108765 14104 log.cc:1196] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/0f8a75779e224bebbc6cce301c58214a
I20260812 20:58:07.109213 14104 ts_tablet_manager.cc:1939] T 0f8a75779e224bebbc6cce301c58214a P 4ce1205163984487bdfe08d98964d061: Deleting consensus metadata
I20260812 20:58:07.109665 14103 ts_tablet_manager.cc:1918] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:07.109879 14103 log.cc:1196] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/0f8a75779e224bebbc6cce301c58214a
I20260812 20:58:07.109835 13159 catalog_manager.cc:4841] TS 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911): tablet 0f8a75779e224bebbc6cce301c58214a (table test-table [id=544377db6dc24c62ab59d1ba2c5169e0]) successfully deleted
I20260812 20:58:07.110375 14103 ts_tablet_manager.cc:1939] T 0f8a75779e224bebbc6cce301c58214a P 31edd026c7884cec80da3d42738c8f1e: Deleting consensus metadata
I20260812 20:58:07.110934 13157 catalog_manager.cc:4841] TS 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137): tablet 0f8a75779e224bebbc6cce301c58214a (table test-table [id=544377db6dc24c62ab59d1ba2c5169e0]) successfully deleted
I20260812 20:58:07.222491 14038 raft_consensus.cc:482] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:07.222679 14038 raft_consensus.cc:504] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.223157 14038 leader_election.cc:288] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443), 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911)
I20260812 20:58:07.227896 14027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.223674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:48201 (local address 127.10.30.67:42911)
0812 20:58:07.223724 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.223726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.223862 (+ 136us) server_negotiation.cc:407] Connection header received
0812 20:58:07.223978 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.223979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.223992 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.224025 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:07.224327 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.225128 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.226859 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.227441 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.227500 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.227526 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.227758 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.227806 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 20:58:07.228226 14116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.223389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42911 (local address 127.10.30.66:48201)
0812 20:58:07.223790 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.223801 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.223895 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.224104 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.224105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.224110 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:07.224248 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.224250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.225238 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.225239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.226744 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.226747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.227600 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.227601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.227674 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.227679 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.228055 (+ 376us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.228111 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":112,"thread_start_us":85,"threads_started":1}
I20260812 20:58:07.228574 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63eb12a90fac45dfbac248d39d985390" candidate_uuid: "31edd026c7884cec80da3d42738c8f1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ce1205163984487bdfe08d98964d061" is_pre_election: true
I20260812 20:58:07.228696 13908 raft_consensus.cc:2454] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31edd026c7884cec80da3d42738c8f1e in term 0.
I20260812 20:58:07.228693 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.223632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:50577 (local address 127.10.30.65:37443)
0812 20:58:07.223699 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.223703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.223867 (+ 164us) server_negotiation.cc:407] Connection header received
0812 20:58:07.223996 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.223997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.224011 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.224043 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:07.224344 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.225156 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.226859 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.227517 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.227574 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.227584 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.228542 (+ 958us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.228606 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 20:58:07.228893 13563 leader_election.cc:302] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31edd026c7884cec80da3d42738c8f1e, 4ce1205163984487bdfe08d98964d061; no voters:
I20260812 20:58:07.229036 14038 raft_consensus.cc:2781] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:07.229068 14038 raft_consensus.cc:482] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:07.229086 14038 raft_consensus.cc:3037] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:07.229343 14117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.223381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:37443 (local address 127.10.30.66:50577)
0812 20:58:07.223786 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.223800 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.223895 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.224119 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.224120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.224122 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:07.224246 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.224249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.225265 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.225266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.226736 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.226741 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.227904 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.227904 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.228438 (+ 534us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.228443 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.229167 (+ 724us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.229227 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":89,"thread_start_us":97,"threads_started":1}
I20260812 20:58:07.229748 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63eb12a90fac45dfbac248d39d985390" candidate_uuid: "31edd026c7884cec80da3d42738c8f1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1856bd93cde42d990c79a0db032493a" is_pre_election: true
I20260812 20:58:07.229884 13445 raft_consensus.cc:2454] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31edd026c7884cec80da3d42738c8f1e in term 0.
I20260812 20:58:07.230191 14038 raft_consensus.cc:504] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.230353 14038 leader_election.cc:288] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [CANDIDATE]: Term 1 election: Requested vote from peers a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443), 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911)
I20260812 20:58:07.230548 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63eb12a90fac45dfbac248d39d985390" candidate_uuid: "31edd026c7884cec80da3d42738c8f1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1856bd93cde42d990c79a0db032493a"
I20260812 20:58:07.230638 13445 raft_consensus.cc:3037] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:07.230595 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63eb12a90fac45dfbac248d39d985390" candidate_uuid: "31edd026c7884cec80da3d42738c8f1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ce1205163984487bdfe08d98964d061"
I20260812 20:58:07.230671 13908 raft_consensus.cc:3037] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:07.231652 13908 raft_consensus.cc:2454] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31edd026c7884cec80da3d42738c8f1e in term 1.
I20260812 20:58:07.231829 13563 leader_election.cc:302] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31edd026c7884cec80da3d42738c8f1e, 4ce1205163984487bdfe08d98964d061; no voters:
I20260812 20:58:07.231889 13445 raft_consensus.cc:2454] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31edd026c7884cec80da3d42738c8f1e in term 1.
I20260812 20:58:07.231915 14038 raft_consensus.cc:2781] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:07.232100 14038 raft_consensus.cc:686] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 1 LEADER]: Becoming Leader. State: Replica: 31edd026c7884cec80da3d42738c8f1e, State: Running, Role: LEADER
I20260812 20:58:07.232172 14038 consensus_queue.cc:237] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:07.233110 13173 catalog_manager.cc:5495] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 31edd026c7884cec80da3d42738c8f1e (127.10.30.66). New cstate: current_term: 1 leader_uuid: "31edd026c7884cec80da3d42738c8f1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:07.256995 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.254152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52354 (local address 127.10.30.66:35137)
0812 20:58:07.254205 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.254207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.254216 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:07.254271 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.254272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.254307 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.254405 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:07.254583 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.255239 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.256044 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.256265 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.256349 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.256553 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.256694 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.256787 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.256832 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.256861 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 20:58:07.263640 14124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.260398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:37443 (local address 127.10.30.66:35601)
0812 20:58:07.260609 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.260621 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.260685 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.260838 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.260838 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.260840 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:07.260911 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.260912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.261952 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.261953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.262609 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.262611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.263123 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.263125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.263201 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.263242 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.263446 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.263448 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.263493 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.263541 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":119,"threads_started":1}
I20260812 20:58:07.263626 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.260480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:35601 (local address 127.10.30.65:37443)
0812 20:58:07.260600 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.260602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.260697 (+ 95us) server_negotiation.cc:407] Connection header received
0812 20:58:07.260738 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.260739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.260754 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.260833 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:07.260988 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.261843 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.262706 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.262979 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.263099 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.263342 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.263381 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.263432 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.263505 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.263534 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 20:58:07.266342 13908 raft_consensus.cc:1261] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Refusing update from remote peer 31edd026c7884cec80da3d42738c8f1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:07.266423 13445 raft_consensus.cc:1261] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Refusing update from remote peer 31edd026c7884cec80da3d42738c8f1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:07.267066 14119 consensus_queue.cc:1035] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:07.267234 14038 consensus_queue.cc:1035] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:07.276607 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.273746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:48863 (local address 127.10.30.66:35137)
0812 20:58:07.273819 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:07.273821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:07.273830 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:07.273859 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:07.273860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:07.273876 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:07.273945 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:07.274113 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.274732 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.275811 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.276189 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.276246 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.276391 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.276424 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.276459 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:07.276518 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 20:58:07.276539 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 20:58:07.276678 14094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:07.273545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35137 (local address 127.10.30.65:48863)
0812 20:58:07.273599 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:07.273614 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:07.273662 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:07.273947 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:07.273949 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:07.273951 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:07.274021 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.274023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.274811 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.274812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.275718 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:07.275721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:07.276248 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:07.276250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:07.276314 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:07.276322 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:07.276465 (+ 143us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:07.276467 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 20:58:07.276515 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 20:58:07.276583 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
W20260812 20:58:07.277139 14072 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 20:58:08.812871 13174 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:08.813040 13174 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:08.814711 13174 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: Sending DeleteTablet for 3 replicas of tablet 63eb12a90fac45dfbac248d39d985390
I20260812 20:58:08.815426 13632 tablet_service.cc:1514] Processing DeleteTablet for tablet 63eb12a90fac45dfbac248d39d985390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:08 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:52342
I20260812 20:58:08.815768 13873 tablet_service.cc:1514] Processing DeleteTablet for tablet 63eb12a90fac45dfbac248d39d985390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:08 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:48564
I20260812 20:58:08.816187 13412 tablet_service.cc:1514] Processing DeleteTablet for tablet 63eb12a90fac45dfbac248d39d985390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:08 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:32906
I20260812 20:58:08.816138 14168 tablet_replica.cc:330] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: stopping tablet replica
I20260812 20:58:08.816326 14168 raft_consensus.cc:2229] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:08.816584 14168 raft_consensus.cc:2258] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:08.816619 14170 tablet_replica.cc:330] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: stopping tablet replica
I20260812 20:58:08.817114 14170 raft_consensus.cc:2229] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:08.817193 14170 raft_consensus.cc:2258] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:08.817253 14169 tablet_replica.cc:330] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: stopping tablet replica
I20260812 20:58:08.817351 14169 raft_consensus.cc:2229] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:08.817409 14169 raft_consensus.cc:2258] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:08.817515 14168 ts_tablet_manager.cc:1905] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:08.819216 14169 ts_tablet_manager.cc:1905] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:08.820755 14170 ts_tablet_manager.cc:1905] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:08.821889 14169 ts_tablet_manager.cc:1918] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 20:58:08.821991 14169 log.cc:1196] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/63eb12a90fac45dfbac248d39d985390
I20260812 20:58:08.822276 14169 ts_tablet_manager.cc:1939] T 63eb12a90fac45dfbac248d39d985390 P 4ce1205163984487bdfe08d98964d061: Deleting consensus metadata
I20260812 20:58:08.822784 14170 ts_tablet_manager.cc:1918] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 20:58:08.822866 14170 log.cc:1196] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/63eb12a90fac45dfbac248d39d985390
I20260812 20:58:08.822981 13159 catalog_manager.cc:4841] TS 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911): tablet 63eb12a90fac45dfbac248d39d985390 (table test-table [id=93d2ceba754749cf9c3fe2d49a24c00e]) successfully deleted
I20260812 20:58:08.823186 14170 ts_tablet_manager.cc:1939] T 63eb12a90fac45dfbac248d39d985390 P a1856bd93cde42d990c79a0db032493a: Deleting consensus metadata
I20260812 20:58:08.823657 13156 catalog_manager.cc:4841] TS a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443): tablet 63eb12a90fac45dfbac248d39d985390 (table test-table [id=93d2ceba754749cf9c3fe2d49a24c00e]) successfully deleted
I20260812 20:58:08.823679 14168 ts_tablet_manager.cc:1918] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 20:58:08.823750 14168 log.cc:1196] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/63eb12a90fac45dfbac248d39d985390
I20260812 20:58:08.824069 14168 ts_tablet_manager.cc:1939] T 63eb12a90fac45dfbac248d39d985390 P 31edd026c7884cec80da3d42738c8f1e: Deleting consensus metadata
I20260812 20:58:08.824496 13157 catalog_manager.cc:4841] TS 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137): tablet 63eb12a90fac45dfbac248d39d985390 (table test-table [id=93d2ceba754749cf9c3fe2d49a24c00e]) successfully deleted
Aug 12 20:58:08 dist-test-slave-h3ft krb5kdc[13098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568288, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 20:58:08 dist-test-slave-h3ft krb5kdc[13098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568288, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:08.861976 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:08.849378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57526 (local address 127.10.30.126:45955)
0812 20:58:08.849695 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:08.849699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:08.850108 (+ 409us) server_negotiation.cc:407] Connection header received
0812 20:58:08.850195 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:08.850213 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:08.850235 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:08.850390 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:08.851310 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:08.852077 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:08.853227 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:08.853729 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:08.853809 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:08.857836 (+ 4027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:08.857839 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:08.857840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:08.857853 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:08.859912 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:08.860392 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:08.860394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:08.860394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:08.860470 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:08.860854 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:08.860856 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:08.860857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:08.861306 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:08.861473 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:08.861663 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 20:58:08.861850 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":179,"threads_started":1}
I20260812 20:58:08.864548 13174 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57526:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:08.864811 13174 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:08.866952 13873 tablet_service.cc:1467] Processing CreateTablet for tablet 84fb47553b9f42c7bdd83d7e045eca49 (DEFAULT_TABLE table=test-table [id=73384908b51a46ab8ff48d9eea43cff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:08.867033 13412 tablet_service.cc:1467] Processing CreateTablet for tablet 84fb47553b9f42c7bdd83d7e045eca49 (DEFAULT_TABLE table=test-table [id=73384908b51a46ab8ff48d9eea43cff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:08.867129 13632 tablet_service.cc:1467] Processing CreateTablet for tablet 84fb47553b9f42c7bdd83d7e045eca49 (DEFAULT_TABLE table=test-table [id=73384908b51a46ab8ff48d9eea43cff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:08.867205 13873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84fb47553b9f42c7bdd83d7e045eca49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:08.867278 13412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84fb47553b9f42c7bdd83d7e045eca49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:08.867300 13632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84fb47553b9f42c7bdd83d7e045eca49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:08.869081 14193 tablet_bootstrap.cc:492] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: Bootstrap starting.
I20260812 20:58:08.869554 14195 tablet_bootstrap.cc:492] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: Bootstrap starting.
I20260812 20:58:08.869709 14194 tablet_bootstrap.cc:492] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: Bootstrap starting.
I20260812 20:58:08.869777 14193 tablet_bootstrap.cc:654] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:08.870127 14194 tablet_bootstrap.cc:654] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:08.870137 14195 tablet_bootstrap.cc:654] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:08.870674 14193 tablet_bootstrap.cc:492] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: No bootstrap required, opened a new log
I20260812 20:58:08.871047 14193 ts_tablet_manager.cc:1397] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:08.871289 14193 raft_consensus.cc:348] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.871414 14193 raft_consensus.cc:374] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:08.871444 14193 raft_consensus.cc:729] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce1205163984487bdfe08d98964d061, State: Initialized, Role: FOLLOWER
I20260812 20:58:08.871549 14193 consensus_queue.cc:260] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.871742 14195 tablet_bootstrap.cc:492] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: No bootstrap required, opened a new log
I20260812 20:58:08.871788 14193 ts_tablet_manager.cc:1428] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:08.871819 14195 ts_tablet_manager.cc:1397] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:08.871994 14195 raft_consensus.cc:348] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.872128 14195 raft_consensus.cc:374] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:08.872157 14195 raft_consensus.cc:729] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1856bd93cde42d990c79a0db032493a, State: Initialized, Role: FOLLOWER
I20260812 20:58:08.872244 14194 tablet_bootstrap.cc:492] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: No bootstrap required, opened a new log
I20260812 20:58:08.872278 14195 consensus_queue.cc:260] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.872607 14195 ts_tablet_manager.cc:1428] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:08.873031 14194 ts_tablet_manager.cc:1397] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 20:58:08.873227 14194 raft_consensus.cc:348] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.873338 14194 raft_consensus.cc:374] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:08.873363 14194 raft_consensus.cc:729] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31edd026c7884cec80da3d42738c8f1e, State: Initialized, Role: FOLLOWER
I20260812 20:58:08.873438 14194 consensus_queue.cc:260] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.873664 14194 ts_tablet_manager.cc:1428] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:08.947765 14133 raft_consensus.cc:482] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:08.947974 14133 raft_consensus.cc:504] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.948266 14133 leader_election.cc:288] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443), 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911)
I20260812 20:58:08.948588 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84fb47553b9f42c7bdd83d7e045eca49" candidate_uuid: "31edd026c7884cec80da3d42738c8f1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1856bd93cde42d990c79a0db032493a" is_pre_election: true
I20260812 20:58:08.948714 13445 raft_consensus.cc:2454] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31edd026c7884cec80da3d42738c8f1e in term 0.
I20260812 20:58:08.948601 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84fb47553b9f42c7bdd83d7e045eca49" candidate_uuid: "31edd026c7884cec80da3d42738c8f1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ce1205163984487bdfe08d98964d061" is_pre_election: true
I20260812 20:58:08.948819 13906 raft_consensus.cc:2454] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31edd026c7884cec80da3d42738c8f1e in term 0.
I20260812 20:58:08.948944 13561 leader_election.cc:302] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31edd026c7884cec80da3d42738c8f1e, a1856bd93cde42d990c79a0db032493a; no voters:
I20260812 20:58:08.949169 14133 raft_consensus.cc:2781] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:08.949256 14133 raft_consensus.cc:482] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:08.949290 14133 raft_consensus.cc:3037] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:08.950474 14133 raft_consensus.cc:504] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.950703 14133 leader_election.cc:288] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [CANDIDATE]: Term 1 election: Requested vote from peers a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443), 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911)
I20260812 20:58:08.950963 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84fb47553b9f42c7bdd83d7e045eca49" candidate_uuid: "31edd026c7884cec80da3d42738c8f1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1856bd93cde42d990c79a0db032493a"
I20260812 20:58:08.950989 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84fb47553b9f42c7bdd83d7e045eca49" candidate_uuid: "31edd026c7884cec80da3d42738c8f1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ce1205163984487bdfe08d98964d061"
I20260812 20:58:08.951114 13906 raft_consensus.cc:3037] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:08.951115 13445 raft_consensus.cc:3037] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:08.952163 13906 raft_consensus.cc:2454] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31edd026c7884cec80da3d42738c8f1e in term 1.
I20260812 20:58:08.952158 13445 raft_consensus.cc:2454] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31edd026c7884cec80da3d42738c8f1e in term 1.
I20260812 20:58:08.952463 13561 leader_election.cc:302] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31edd026c7884cec80da3d42738c8f1e, a1856bd93cde42d990c79a0db032493a; no voters:
I20260812 20:58:08.952653 14133 raft_consensus.cc:2781] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:08.952739 14133 raft_consensus.cc:686] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 1 LEADER]: Becoming Leader. State: Replica: 31edd026c7884cec80da3d42738c8f1e, State: Running, Role: LEADER
I20260812 20:58:08.952806 14133 consensus_queue.cc:237] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:08.953781 13174 catalog_manager.cc:5495] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 31edd026c7884cec80da3d42738c8f1e (127.10.30.66). New cstate: current_term: 1 leader_uuid: "31edd026c7884cec80da3d42738c8f1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:08.974323 14213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:08.971231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35614 (local address 127.10.30.66:35137)
0812 20:58:08.971445 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:08.971448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:08.971459 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:08.971496 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:08.971496 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:08.971511 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:08.971586 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:08.971796 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:08.972483 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:08.973464 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:08.973718 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:08.973789 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:08.973946 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:08.973988 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:08.974070 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:08.974142 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 20:58:08.974170 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":145,"threads_started":1}
I20260812 20:58:08.977634 13445 raft_consensus.cc:1261] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Refusing update from remote peer 31edd026c7884cec80da3d42738c8f1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:08.977669 13906 raft_consensus.cc:1261] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Refusing update from remote peer 31edd026c7884cec80da3d42738c8f1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:08.977898 14152 consensus_queue.cc:1035] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:08.978020 14133 consensus_queue.cc:1035] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:08.993239 13174 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:08.993427 13174 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:08.994274 13174 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: Sending DeleteTablet for 3 replicas of tablet 84fb47553b9f42c7bdd83d7e045eca49
I20260812 20:58:08.994585 13412 tablet_service.cc:1514] Processing DeleteTablet for tablet 84fb47553b9f42c7bdd83d7e045eca49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:08 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:32906
I20260812 20:58:08.994643 13873 tablet_service.cc:1514] Processing DeleteTablet for tablet 84fb47553b9f42c7bdd83d7e045eca49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:08 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:48564
I20260812 20:58:08.994712 14170 tablet_replica.cc:330] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: stopping tablet replica
I20260812 20:58:08.994752 14169 tablet_replica.cc:330] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: stopping tablet replica
I20260812 20:58:08.994701 13632 tablet_service.cc:1514] Processing DeleteTablet for tablet 84fb47553b9f42c7bdd83d7e045eca49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:08 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:52342
I20260812 20:58:08.994787 14170 raft_consensus.cc:2229] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:08.994820 14169 raft_consensus.cc:2229] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:08.994850 14170 raft_consensus.cc:2258] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:08.994874 14169 raft_consensus.cc:2258] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:08.994948 14168 tablet_replica.cc:330] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: stopping tablet replica
I20260812 20:58:08.994863 13174 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57526:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 20:58:08.995059 14168 raft_consensus.cc:2229] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:08.995146 14168 raft_consensus.cc:2258] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 20:58:08.995133 13174 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:08.995371 14169 ts_tablet_manager.cc:1905] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:08.995779 14170 ts_tablet_manager.cc:1905] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:08.995826 14168 ts_tablet_manager.cc:1905] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:08.997555 14168 ts_tablet_manager.cc:1918] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:08.997562 14169 ts_tablet_manager.cc:1918] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:08.997630 14168 log.cc:1196] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/84fb47553b9f42c7bdd83d7e045eca49
I20260812 20:58:08.997630 14169 log.cc:1196] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/84fb47553b9f42c7bdd83d7e045eca49
I20260812 20:58:08.997679 14170 ts_tablet_manager.cc:1918] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:08.997756 14170 log.cc:1196] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/84fb47553b9f42c7bdd83d7e045eca49
I20260812 20:58:08.997905 14168 ts_tablet_manager.cc:1939] T 84fb47553b9f42c7bdd83d7e045eca49 P 31edd026c7884cec80da3d42738c8f1e: Deleting consensus metadata
I20260812 20:58:08.997905 14169 ts_tablet_manager.cc:1939] T 84fb47553b9f42c7bdd83d7e045eca49 P 4ce1205163984487bdfe08d98964d061: Deleting consensus metadata
I20260812 20:58:08.998052 14170 ts_tablet_manager.cc:1939] T 84fb47553b9f42c7bdd83d7e045eca49 P a1856bd93cde42d990c79a0db032493a: Deleting consensus metadata
I20260812 20:58:08.998322 13157 catalog_manager.cc:4841] TS 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137): tablet 84fb47553b9f42c7bdd83d7e045eca49 (table test-table [id=73384908b51a46ab8ff48d9eea43cff8]) successfully deleted
I20260812 20:58:08.998332 13159 catalog_manager.cc:4841] TS 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911): tablet 84fb47553b9f42c7bdd83d7e045eca49 (table test-table [id=73384908b51a46ab8ff48d9eea43cff8]) successfully deleted
I20260812 20:58:08.998560 13156 catalog_manager.cc:4841] TS a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443): tablet 84fb47553b9f42c7bdd83d7e045eca49 (table test-table [id=73384908b51a46ab8ff48d9eea43cff8]) successfully deleted
I20260812 20:58:08.998960 13873 tablet_service.cc:1467] Processing CreateTablet for tablet 28c054f2ebc9492096ea218fa0d3e330 (DEFAULT_TABLE table=test-table [id=bfcc65c762604b6794072aa910a81048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:08.999061 13412 tablet_service.cc:1467] Processing CreateTablet for tablet 28c054f2ebc9492096ea218fa0d3e330 (DEFAULT_TABLE table=test-table [id=bfcc65c762604b6794072aa910a81048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:08.999176 13873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c054f2ebc9492096ea218fa0d3e330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:08.999207 13412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c054f2ebc9492096ea218fa0d3e330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:09.000211 14195 tablet_bootstrap.cc:492] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a: Bootstrap starting.
I20260812 20:58:09.000391 14193 tablet_bootstrap.cc:492] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: Bootstrap starting.
I20260812 20:58:09.000610 13632 tablet_service.cc:1467] Processing CreateTablet for tablet 28c054f2ebc9492096ea218fa0d3e330 (DEFAULT_TABLE table=test-table [id=bfcc65c762604b6794072aa910a81048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:09.000671 14195 tablet_bootstrap.cc:654] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:09.000756 13632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c054f2ebc9492096ea218fa0d3e330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:09.000757 14193 tablet_bootstrap.cc:654] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:09.001444 14195 tablet_bootstrap.cc:492] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a: No bootstrap required, opened a new log
I20260812 20:58:09.001519 14195 ts_tablet_manager.cc:1397] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:09.001678 14195 raft_consensus.cc:348] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.001768 14195 raft_consensus.cc:374] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:09.001796 14195 raft_consensus.cc:729] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1856bd93cde42d990c79a0db032493a, State: Initialized, Role: FOLLOWER
I20260812 20:58:09.001852 14195 consensus_queue.cc:260] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.001960 14195 ts_tablet_manager.cc:1428] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 20:58:09.002262 14193 tablet_bootstrap.cc:492] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: No bootstrap required, opened a new log
I20260812 20:58:09.002331 14193 ts_tablet_manager.cc:1397] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:09.002460 14194 tablet_bootstrap.cc:492] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: Bootstrap starting.
I20260812 20:58:09.002451 14193 raft_consensus.cc:348] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.002523 14193 raft_consensus.cc:374] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:09.002543 14193 raft_consensus.cc:729] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce1205163984487bdfe08d98964d061, State: Initialized, Role: FOLLOWER
I20260812 20:58:09.002588 14193 consensus_queue.cc:260] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.002714 14193 ts_tablet_manager.cc:1428] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 20:58:09.002847 14194 tablet_bootstrap.cc:654] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:09.003516 14194 tablet_bootstrap.cc:492] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: No bootstrap required, opened a new log
I20260812 20:58:09.003592 14194 ts_tablet_manager.cc:1397] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:09.003774 14194 raft_consensus.cc:348] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.003859 14194 raft_consensus.cc:374] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:09.003880 14194 raft_consensus.cc:729] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31edd026c7884cec80da3d42738c8f1e, State: Initialized, Role: FOLLOWER
I20260812 20:58:09.003926 14194 consensus_queue.cc:260] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.004041 14194 ts_tablet_manager.cc:1428] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 20:58:09.081477 14202 raft_consensus.cc:482] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:09.081647 14202 raft_consensus.cc:504] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.081930 14202 leader_election.cc:288] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443), 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137)
I20260812 20:58:09.082340 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c054f2ebc9492096ea218fa0d3e330" candidate_uuid: "4ce1205163984487bdfe08d98964d061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1856bd93cde42d990c79a0db032493a" is_pre_election: true
I20260812 20:58:09.082401 13665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c054f2ebc9492096ea218fa0d3e330" candidate_uuid: "4ce1205163984487bdfe08d98964d061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31edd026c7884cec80da3d42738c8f1e" is_pre_election: true
I20260812 20:58:09.082520 13445 raft_consensus.cc:2454] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ce1205163984487bdfe08d98964d061 in term 0.
I20260812 20:58:09.082543 13665 raft_consensus.cc:2454] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ce1205163984487bdfe08d98964d061 in term 0.
I20260812 20:58:09.082747 13786 leader_election.cc:302] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ce1205163984487bdfe08d98964d061, a1856bd93cde42d990c79a0db032493a; no voters:
I20260812 20:58:09.082901 14202 raft_consensus.cc:2781] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:09.082960 14202 raft_consensus.cc:482] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:09.082981 14202 raft_consensus.cc:3037] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:09.083962 14202 raft_consensus.cc:504] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.084138 14202 leader_election.cc:288] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [CANDIDATE]: Term 1 election: Requested vote from peers a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443), 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137)
I20260812 20:58:09.084347 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c054f2ebc9492096ea218fa0d3e330" candidate_uuid: "4ce1205163984487bdfe08d98964d061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1856bd93cde42d990c79a0db032493a"
I20260812 20:58:09.084395 13665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c054f2ebc9492096ea218fa0d3e330" candidate_uuid: "4ce1205163984487bdfe08d98964d061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31edd026c7884cec80da3d42738c8f1e"
I20260812 20:58:09.084458 13445 raft_consensus.cc:3037] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:09.084506 13665 raft_consensus.cc:3037] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:09.085263 13665 raft_consensus.cc:2454] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ce1205163984487bdfe08d98964d061 in term 1.
I20260812 20:58:09.085281 13445 raft_consensus.cc:2454] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ce1205163984487bdfe08d98964d061 in term 1.
I20260812 20:58:09.085489 13787 leader_election.cc:302] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31edd026c7884cec80da3d42738c8f1e, 4ce1205163984487bdfe08d98964d061; no voters:
I20260812 20:58:09.085618 14202 raft_consensus.cc:2781] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:09.085763 14202 raft_consensus.cc:686] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 1 LEADER]: Becoming Leader. State: Replica: 4ce1205163984487bdfe08d98964d061, State: Running, Role: LEADER
I20260812 20:58:09.085816 14202 consensus_queue.cc:237] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } }
I20260812 20:58:09.086692 13174 catalog_manager.cc:5495] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ce1205163984487bdfe08d98964d061 (127.10.30.67). New cstate: current_term: 1 leader_uuid: "4ce1205163984487bdfe08d98964d061" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ce1205163984487bdfe08d98964d061" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42911 } health_report { overall_health: HEALTHY } } }
I20260812 20:58:09.105186 14228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:09.101774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52990 (local address 127.10.30.67:42911)
0812 20:58:09.102123 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:09.102126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:09.102136 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:09.102166 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:09.102166 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:09.102181 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:09.102268 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:09.102528 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:09.103164 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:09.104245 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:09.104566 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:09.104648 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:09.104864 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:09.104910 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:09.104973 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:09.105045 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 20:58:09.105078 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":178,"threads_started":1}
I20260812 20:58:09.108842 13665 raft_consensus.cc:1261] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Refusing update from remote peer 4ce1205163984487bdfe08d98964d061: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:09.108858 13445 raft_consensus.cc:1261] T 28c054f2ebc9492096ea218fa0d3e330 P a1856bd93cde42d990c79a0db032493a [term 1 FOLLOWER]: Refusing update from remote peer 4ce1205163984487bdfe08d98964d061: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:09.109149 14202 consensus_queue.cc:1035] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31edd026c7884cec80da3d42738c8f1e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:09.109333 14223 consensus_queue.cc:1035] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1856bd93cde42d990c79a0db032493a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 20:58:09.115434 14140 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 20:58:10.642442 13173 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:10.642565 13173 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:10.643684 13173 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7c03552722d494a893cd735be8838b2: Sending DeleteTablet for 3 replicas of tablet 28c054f2ebc9492096ea218fa0d3e330
I20260812 20:58:10.644057 13412 tablet_service.cc:1514] Processing DeleteTablet for tablet 28c054f2ebc9492096ea218fa0d3e330 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:10 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:32906
I20260812 20:58:10.644094 13873 tablet_service.cc:1514] Processing DeleteTablet for tablet 28c054f2ebc9492096ea218fa0d3e330 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:10 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:48564
I20260812 20:58:10.644166 13632 tablet_service.cc:1514] Processing DeleteTablet for tablet 28c054f2ebc9492096ea218fa0d3e330 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:10 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:52342
I20260812 20:58:10.644387 14273 tablet_replica.cc:330] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: stopping tablet replica
I20260812 20:58:10.644469 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13308
I20260812 20:58:10.653110 14274 tablet_replica.cc:330] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: stopping tablet replica
I20260812 20:58:10.653208 14274 raft_consensus.cc:2229] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:10.653268 14274 raft_consensus.cc:2258] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:10.653653 14274 ts_tablet_manager.cc:1905] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:10.644518 14273 raft_consensus.cc:2229] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:10.654094 14273 raft_consensus.cc:2258] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:10.655326 14273 ts_tablet_manager.cc:1905] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:10.655997 14274 ts_tablet_manager.cc:1918] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 20:58:10.656090 14274 log.cc:1196] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/28c054f2ebc9492096ea218fa0d3e330
I20260812 20:58:10.656338 14274 ts_tablet_manager.cc:1939] T 28c054f2ebc9492096ea218fa0d3e330 P 31edd026c7884cec80da3d42738c8f1e: Deleting consensus metadata
I20260812 20:58:10.656895 13157 catalog_manager.cc:4841] TS 31edd026c7884cec80da3d42738c8f1e (127.10.30.66:35137): tablet 28c054f2ebc9492096ea218fa0d3e330 (table test-table [id=bfcc65c762604b6794072aa910a81048]) successfully deleted
I20260812 20:58:10.657405 14273 ts_tablet_manager.cc:1918] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 20:58:10.657493 14273 log.cc:1196] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/28c054f2ebc9492096ea218fa0d3e330
I20260812 20:58:10.657758 14273 ts_tablet_manager.cc:1939] T 28c054f2ebc9492096ea218fa0d3e330 P 4ce1205163984487bdfe08d98964d061: Deleting consensus metadata
I20260812 20:58:10.658241 13159 catalog_manager.cc:4841] TS 4ce1205163984487bdfe08d98964d061 (127.10.30.67:42911): tablet 28c054f2ebc9492096ea218fa0d3e330 (table test-table [id=bfcc65c762604b6794072aa910a81048]) successfully deleted
W20260812 20:58:10.662634 13156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:37443 (error 108)
I20260812 20:58:10.663031 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13538
I20260812 20:58:10.674803 14276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:10.669462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:37443 (local address 127.0.0.1:36630)
0812 20:58:10.674641 (+ 5179us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:10.674742 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:37443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5142,"thread_start_us":2031,"threads_started":1}
W20260812 20:58:10.674973 13156 catalog_manager.cc:4584] TS a1856bd93cde42d990c79a0db032493a (127.10.30.65:37443): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 28c054f2ebc9492096ea218fa0d3e330: Network error: Client connection negotiation failed: client connection to 127.10.30.65:37443: connect: Connection refused (error 111)
I20260812 20:58:10.686589 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13755
I20260812 20:58:10.696472 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13129
2026-08-12T20:58:10Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6330 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:10 dist-test-slave-h3ft krb5kdc[14283](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:10 dist-test-slave-h3ft krb5kdc[14283](info): set up 2 sockets
Aug 12 20:58:10 dist-test-slave-h3ft krb5kdc[14283](info): commencing operation
krb5kdc: starting...
W20260812 20:58:12.085618 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.351s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:12 dist-test-slave-h3ft krb5kdc[14283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:12.243415 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:36133
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:36133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:12.340410 14301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:12.340682 14301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:12.340708 14301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:12.342083 14301 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:12.342149 14301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:12.342164 14301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:12.342178 14301 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:12.342191 14301 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:12.343896 14301 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:36133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:36133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:12.344237 14301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:12.344540 14301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 20:58:12.350507 14301 server_base.cc:1034] running on GCE node
W20260812 20:58:12.350409 14314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:12.350425 14318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:12.350440 14315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:12.351189 14301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:12.351496 14301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:12.352658 14301 hybrid_clock.cc:648] HybridClock initialized: now 1786568292352618 us; error 64 us; skew 500 ppm
Aug 12 20:58:12 dist-test-slave-h3ft krb5kdc[14283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:12.355827 14301 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:12.356370 14301 webserver.cc:460] Webserver started at http://127.10.30.126:41811/ using document root <none> and password file <none>
I20260812 20:58:12.356647 14301 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:12.356719 14301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:12.356891 14301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:12.358196 14301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "afa7207757e24e2db0a6796717d32f72"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "f2e6b99732e116d3523b0d328bff9a4d"
server_key_iv: "fe30213fd19970d7739b78108600f550"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.358644 14301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "afa7207757e24e2db0a6796717d32f72"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "f2e6b99732e116d3523b0d328bff9a4d"
server_key_iv: "fe30213fd19970d7739b78108600f550"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.360317 14301 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 20:58:12.361304 14326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:12.361518 14301 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:12.361644 14301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "afa7207757e24e2db0a6796717d32f72"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "f2e6b99732e116d3523b0d328bff9a4d"
server_key_iv: "fe30213fd19970d7739b78108600f550"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.361732 14301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:12.382658 14301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:12.385927 14301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:12.386157 14301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:12.391744 14301 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:36133
I20260812 20:58:12.391783 14405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:36133 every 8 connection(s)
I20260812 20:58:12.392268 14301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:12.393430 14407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:12.396461 14407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72: Bootstrap starting.
I20260812 20:58:12.397269 14407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:12.397647 14407 log.cc:824] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:12.398588 14407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72: No bootstrap required, opened a new log
I20260812 20:58:12.400605 14407 raft_consensus.cc:348] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa7207757e24e2db0a6796717d32f72" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36133 } }
I20260812 20:58:12.400786 14407 raft_consensus.cc:374] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:12.400812 14407 raft_consensus.cc:729] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa7207757e24e2db0a6796717d32f72, State: Initialized, Role: FOLLOWER
I20260812 20:58:12.401007 14407 consensus_queue.cc:260] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa7207757e24e2db0a6796717d32f72" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36133 } }
I20260812 20:58:12.401100 14407 raft_consensus.cc:388] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:12.401126 14407 raft_consensus.cc:482] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:12.401189 14407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:12.401700 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14301
I20260812 20:58:12.401827 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:12.401938 14407 raft_consensus.cc:504] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa7207757e24e2db0a6796717d32f72" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36133 } }
I20260812 20:58:12.402074 14407 leader_election.cc:302] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afa7207757e24e2db0a6796717d32f72; no voters:
I20260812 20:58:12.402118 10361 external_mini_cluster.cc:1428] Setting key d8cc93bd18cb3cf978112718a1d5b067
I20260812 20:58:12.402347 14407 leader_election.cc:288] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:12.402385 14412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:12.402542 14412 raft_consensus.cc:686] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [term 1 LEADER]: Becoming Leader. State: Replica: afa7207757e24e2db0a6796717d32f72, State: Running, Role: LEADER
I20260812 20:58:12.402653 14412 consensus_queue.cc:237] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa7207757e24e2db0a6796717d32f72" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36133 } }
I20260812 20:58:12.402697 14407 sys_catalog.cc:564] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:12.403043 14412 sys_catalog.cc:455] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afa7207757e24e2db0a6796717d32f72. Latest consensus state: current_term: 1 leader_uuid: "afa7207757e24e2db0a6796717d32f72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa7207757e24e2db0a6796717d32f72" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36133 } } }
I20260812 20:58:12.403126 14412 sys_catalog.cc:458] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:12.403061 14413 sys_catalog.cc:455] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afa7207757e24e2db0a6796717d32f72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa7207757e24e2db0a6796717d32f72" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36133 } } }
I20260812 20:58:12.403337 14413 sys_catalog.cc:458] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:12.403764 14420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:12.404493 14420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:12.406948 14420 catalog_manager.cc:1347] Generated new cluster ID: 8768ca4268504c8da0e447f975072305
I20260812 20:58:12.407030 14420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 20:58:12 dist-test-slave-h3ft krb5kdc[14283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:12.417117 14430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:12.403442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54006 (local address 127.10.30.126:36133)
0812 20:58:12.403743 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:12.403756 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:12.403796 (+ 40us) server_negotiation.cc:407] Connection header received
0812 20:58:12.404425 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:12.404434 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:12.404522 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:12.405673 (+ 1151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:12.405797 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.407274 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.408427 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.409068 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.409171 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:12.412635 (+ 3464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:12.412641 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:12.412641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:12.412657 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:12.414986 (+ 2329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:12.415468 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:12.415472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:12.415473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:12.415616 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:12.415854 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:12.415855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:12.415856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:12.416242 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:12.416426 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:12.416544 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 20:58:12.416700 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":125,"threads_started":1}
I20260812 20:58:12.426585 14420 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:12.427474 14420 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:12.432961 14420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afa7207757e24e2db0a6796717d32f72: Generated new TSK 0
I20260812 20:58:12.433228 14420 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:12.472769 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36133
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:12.570443 14451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:12.570716 14451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:12.570745 14451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:12.572052 14451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:12.572103 14451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:12.572131 14451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:12.573794 14451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:12.574069 14451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:12.574306 14451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:12.580508 14468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:12.580490 14473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:12.580574 14465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:12.581032 14451 server_base.cc:1034] running on GCE node
I20260812 20:58:12.581310 14451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:12.581615 14451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:12.582798 14451 hybrid_clock.cc:648] HybridClock initialized: now 1786568292582781 us; error 50 us; skew 500 ppm
Aug 12 20:58:12 dist-test-slave-h3ft krb5kdc[14283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:12.586187 14451 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:12.586798 14451 webserver.cc:460] Webserver started at http://127.10.30.65:32915/ using document root <none> and password file <none>
I20260812 20:58:12.587205 14451 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:12.587291 14451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:12.587491 14451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:12.588899 14451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "16c2cf3167c5474e9f44d6e65e89ab55"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "549c5ca77d74500925a8f740c77dd4c9"
server_key_iv: "cd2e864169a0ed73f97d68e88ec46d54"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.589373 14451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "16c2cf3167c5474e9f44d6e65e89ab55"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "549c5ca77d74500925a8f740c77dd4c9"
server_key_iv: "cd2e864169a0ed73f97d68e88ec46d54"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.591223 14451 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:12.592258 14484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:12.592504 14451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:12.592641 14451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "16c2cf3167c5474e9f44d6e65e89ab55"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "549c5ca77d74500925a8f740c77dd4c9"
server_key_iv: "cd2e864169a0ed73f97d68e88ec46d54"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.592730 14451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:12.608273 14451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:12.610965 14451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:12.611207 14451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:12.611536 14451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:12.611933 14451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:12.611996 14451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:12.612047 14451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:12.612071 14451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:12.619735 14451 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:42649
I20260812 20:58:12.619788 14675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:42649 every 8 connection(s)
I20260812 20:58:12.620199 14451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
Aug 12 20:58:12 dist-test-slave-h3ft krb5kdc[14283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:12.630542 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14451
I20260812 20:58:12.630709 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:12.630965 10361 external_mini_cluster.cc:1428] Setting key 7eb6768d575e7a230f82dd6aed57fee3
I20260812 20:58:12.632196 14430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:12.621118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:39355 (local address 127.10.30.126:36133)
0812 20:58:12.621181 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:12.621185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:12.621390 (+ 205us) server_negotiation.cc:407] Connection header received
0812 20:58:12.622068 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:12.622070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:12.622088 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:12.622161 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:12.623483 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.624092 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.625243 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.625472 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.625536 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:12.628269 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:12.628271 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:12.628271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:12.628281 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:12.630011 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:12.630539 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:12.630540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:12.630541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:12.630646 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:12.631135 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:12.631136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:12.631137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:12.631300 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:12.631395 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:12.631941 (+ 546us) server_negotiation.cc:299] Negotiation successful
0812 20:58:12.632080 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 20:58:12.632274 14680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:12.621044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36133 (local address 127.10.30.65:39355)
0812 20:58:12.621230 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:12.621280 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:12.621876 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:12.622295 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:12.622300 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:12.623093 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:12.623343 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:12.623349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.624212 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.624213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:12.625136 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:12.625139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.625562 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.625563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:12.625693 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:12.626295 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:12.626306 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:12.628129 (+ 1823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:12.630126 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:12.630135 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:12.630137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:12.630404 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:12.630799 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:12.630801 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:12.630801 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:12.630994 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:12.631383 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:12.631392 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:12.631622 (+ 230us) client_negotiation.cc:769] Sending connection context
0812 20:58:12.631747 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 20:58:12.632001 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":104,"threads_started":1}
I20260812 20:58:12.632941 14677 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36133
I20260812 20:58:12.633083 14677 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:12.633348 14677 heartbeater.cc:511] Master 127.10.30.126:36133 requested a full tablet report, sending...
I20260812 20:58:12.634037 14354 ts_manager.cc:194] Registered new tserver with Master: 16c2cf3167c5474e9f44d6e65e89ab55 (127.10.30.65:42649)
I20260812 20:58:12.634842 14354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:39355
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:12.666360 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36133
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:12.780289 14686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:12.780550 14686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:12.780576 14686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:12.781939 14686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:12.781996 14686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:12.782025 14686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:12.783743 14686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:12.784029 14686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:12.784262 14686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:12.790688 14694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:12.790697 14692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:12.790691 14696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:12.790736 14686 server_base.cc:1034] running on GCE node
I20260812 20:58:12.791352 14686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:12.791672 14686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:12.792879 14686 hybrid_clock.cc:648] HybridClock initialized: now 1786568292792868 us; error 44 us; skew 500 ppm
Aug 12 20:58:12 dist-test-slave-h3ft krb5kdc[14283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:12.796319 14686 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:12.796872 14686 webserver.cc:460] Webserver started at http://127.10.30.66:35249/ using document root <none> and password file <none>
I20260812 20:58:12.797148 14686 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:12.797199 14686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:12.797364 14686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:12.798663 14686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "555b89f2a7be4ace8d60c95f5e3be6da"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "faf689a340eb7e98b72af2ccf4df08f9"
server_key_iv: "d926bf2bc1e46eafea5199af095e4fec"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.799180 14686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "555b89f2a7be4ace8d60c95f5e3be6da"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "faf689a340eb7e98b72af2ccf4df08f9"
server_key_iv: "d926bf2bc1e46eafea5199af095e4fec"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.800913 14686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:12.802032 14706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:12.802333 14686 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:12.802477 14686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "555b89f2a7be4ace8d60c95f5e3be6da"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "faf689a340eb7e98b72af2ccf4df08f9"
server_key_iv: "d926bf2bc1e46eafea5199af095e4fec"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.802568 14686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:12.817240 14686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:12.820029 14686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:12.820245 14686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:12.820555 14686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:12.820958 14686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:12.821020 14686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:12.821060 14686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:12.821107 14686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:12.829123 14686 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:39429
I20260812 20:58:12.829171 14879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:39429 every 8 connection(s)
I20260812 20:58:12.829618 14686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:12.835412 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14686
I20260812 20:58:12.835523 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:12.835777 10361 external_mini_cluster.cc:1428] Setting key d0dca3896ac154b29d00d8e6def522d3
Aug 12 20:58:12 dist-test-slave-h3ft krb5kdc[14283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:12.844177 14430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:12.830822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:46295 (local address 127.10.30.126:36133)
0812 20:58:12.830917 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:12.830921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:12.831258 (+ 337us) server_negotiation.cc:407] Connection header received
0812 20:58:12.832502 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:12.832504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:12.832525 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:12.832597 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:12.834043 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.834627 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.835944 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.836219 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.836313 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:12.839462 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:12.839464 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:12.839465 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:12.839475 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:12.841632 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:12.842374 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:12.842376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:12.842377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:12.842483 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:12.842875 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:12.842876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:12.842876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:12.843148 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:12.843230 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:12.843729 (+ 499us) server_negotiation.cc:299] Negotiation successful
0812 20:58:12.843936 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 20:58:12.844277 14886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:12.830738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36133 (local address 127.10.30.66:46295)
0812 20:58:12.831041 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:12.831112 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:12.832317 (+ 1205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:12.832717 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:12.832723 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:12.833605 (+ 882us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:12.833864 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:12.833870 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.834755 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.834756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:12.835791 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:12.835794 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:12.836322 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:12.836323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:12.836474 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:12.837245 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:12.837256 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:12.839324 (+ 2068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:12.841755 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:12.841765 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:12.841767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:12.842203 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:12.842552 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:12.842554 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:12.842554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:12.842764 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:12.843244 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:12.843255 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:12.843507 (+ 252us) client_negotiation.cc:769] Sending connection context
0812 20:58:12.843650 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 20:58:12.843906 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":112,"threads_started":1}
I20260812 20:58:12.847905 14880 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36133
I20260812 20:58:12.848099 14880 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:12.848392 14880 heartbeater.cc:511] Master 127.10.30.126:36133 requested a full tablet report, sending...
I20260812 20:58:12.848928 14354 ts_manager.cc:194] Registered new tserver with Master: 555b89f2a7be4ace8d60c95f5e3be6da (127.10.30.66:39429)
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
I20260812 20:58:12.849601 14354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:46295
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:12.875663 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36133
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:12.975132 14890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:12.975432 14890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:12.975461 14890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:12.977290 14890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:12.977344 14890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:12.977375 14890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:12.979128 14890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:12.979455 14890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:12.979736 14890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:12.986588 14895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:12.986542 14896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:12.986691 14890 server_base.cc:1034] running on GCE node
W20260812 20:58:12.986544 14900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:12.987133 14890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:12.987457 14890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:12.988651 14890 hybrid_clock.cc:648] HybridClock initialized: now 1786568292988634 us; error 32 us; skew 500 ppm
Aug 12 20:58:12 dist-test-slave-h3ft krb5kdc[14283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:12.991809 14890 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:12.992383 14890 webserver.cc:460] Webserver started at http://127.10.30.67:38151/ using document root <none> and password file <none>
I20260812 20:58:12.992657 14890 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:12.992733 14890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:12.992941 14890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:12.994216 14890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "ef3f261365a746e1b31c44abc49422e5"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "3cc5a7e754f75af93fffa3ec2b295201"
server_key_iv: "88d3dae5baa7252ac9e690bf4e38e7e1"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.994638 14890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "ef3f261365a746e1b31c44abc49422e5"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "3cc5a7e754f75af93fffa3ec2b295201"
server_key_iv: "88d3dae5baa7252ac9e690bf4e38e7e1"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.996425 14890 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:12.997506 14910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:12.997745 14890 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:12.997928 14890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "ef3f261365a746e1b31c44abc49422e5"
format_stamp: "Formatted at 2026-08-12 20:58:12 on dist-test-slave-h3ft"
server_key: "3cc5a7e754f75af93fffa3ec2b295201"
server_key_iv: "88d3dae5baa7252ac9e690bf4e38e7e1"
server_key_version: "encryptionkey@0"
I20260812 20:58:12.998023 14890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:13.010190 14890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:13.014276 14890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:13.014542 14890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:13.014921 14890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:13.015413 14890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:13.015482 14890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:13.015542 14890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:13.015571 14890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:13.025287 14890 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:35475
I20260812 20:58:13.025327 15105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:35475 every 8 connection(s)
I20260812 20:58:13.025933 14890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:13.033761 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14890
I20260812 20:58:13.033913 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:13.034188 10361 external_mini_cluster.cc:1428] Setting key 16ef8dcd7edd70d315d589c60103782b
Aug 12 20:58:13 dist-test-slave-h3ft krb5kdc[14283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568292, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:13.039546 14430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:13.027064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:45985 (local address 127.10.30.126:36133)
0812 20:58:13.027153 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:13.027156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:13.027482 (+ 326us) server_negotiation.cc:407] Connection header received
0812 20:58:13.028210 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:13.028212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:13.028230 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:13.028317 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:13.029585 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:13.030167 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:13.031498 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:13.031722 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:13.031818 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:13.035858 (+ 4040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:13.035859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:13.035860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:13.035868 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:13.037594 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:13.038210 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:13.038211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:13.038212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:13.038311 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:13.038672 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:13.038673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:13.038673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:13.038850 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:13.038916 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:13.039358 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 20:58:13.039463 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 20:58:13.039736 15109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:13.026986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36133 (local address 127.10.30.67:45985)
0812 20:58:13.027305 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:13.027355 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:13.028078 (+ 723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:13.028419 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:13.028424 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:13.029194 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:13.029458 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:13.029464 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:13.030301 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:13.030308 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:13.031392 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:13.031395 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:13.031837 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:13.031838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:13.031999 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:13.033244 (+ 1245us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:13.033255 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:13.035750 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:13.037751 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:13.037764 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:13.037766 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:13.038091 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:13.038404 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:13.038405 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:13.038406 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:13.038548 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:13.038942 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:13.038953 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:13.039203 (+ 250us) client_negotiation.cc:769] Sending connection context
0812 20:58:13.039307 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 20:58:13.039483 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":156,"threads_started":1}
I20260812 20:58:13.040311 15106 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36133
I20260812 20:58:13.040462 15106 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:13.040755 15106 heartbeater.cc:511] Master 127.10.30.126:36133 requested a full tablet report, sending...
I20260812 20:58:13.041330 14354 ts_manager.cc:194] Registered new tserver with Master: ef3f261365a746e1b31c44abc49422e5 (127.10.30.67:35475)
I20260812 20:58:13.041772 14354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:45985
I20260812 20:58:13.047540 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 20:58:13.064085 14430 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:13.062684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54008 (local address 127.10.30.126:36133)
0812 20:58:13.062790 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:13.062793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:13.062977 (+ 184us) server_negotiation.cc:407] Connection header received
0812 20:58:13.063113 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:13.063119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:13.063133 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:13.063206 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:13.063967 (+ 761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54008: BlockingRecv error: recv got EOF from 127.0.0.1:54008 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 20:58:13.065356 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14451
I20260812 20:58:13.099483 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14686
I20260812 20:58:13.144296 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14890
I20260812 20:58:13.162846 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14301
2026-08-12T20:58:13Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2466 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:14 dist-test-slave-h3ft krb5kdc[15123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:14 dist-test-slave-h3ft krb5kdc[15123](info): set up 2 sockets
Aug 12 20:58:14 dist-test-slave-h3ft krb5kdc[15123](info): commencing operation
krb5kdc: starting...
W20260812 20:58:16.008677 10361 mini_kdc.cc:121] Time spent starting KDC: real 2.807s user 0.007s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:16 dist-test-slave-h3ft krb5kdc[15123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:16.168236 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:33717
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:33717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:16.271598 15148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:16.271965 15148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:16.272017 15148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:16.273371 15148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:16.273463 15148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:16.273489 15148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:16.273511 15148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:16.273533 15148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:16.275394 15148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:33717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:33717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:16.275753 15148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:16.276046 15148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:16.281927 15157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:16.282011 15160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:16.281929 15156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:16.282202 15148 server_base.cc:1034] running on GCE node
I20260812 20:58:16.282617 15148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:16.283099 15148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:16.284317 15148 hybrid_clock.cc:648] HybridClock initialized: now 1786568296284299 us; error 49 us; skew 500 ppm
Aug 12 20:58:16 dist-test-slave-h3ft krb5kdc[15123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568296, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:16.287853 15148 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:16.288558 15148 webserver.cc:460] Webserver started at http://127.10.30.126:41557/ using document root <none> and password file <none>
I20260812 20:58:16.288859 15148 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:16.288954 15148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:16.289139 15148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:16.290566 15148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "89073b6c82104bdfb78191c076fda3b9"
format_stamp: "Formatted at 2026-08-12 20:58:16 on dist-test-slave-h3ft"
server_key: "b0d68601df59ff2c2acb17f26d0a74d5"
server_key_iv: "29737e1e5c3f66de2a0a94253c2a86ad"
server_key_version: "encryptionkey@0"
I20260812 20:58:16.291139 15148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "89073b6c82104bdfb78191c076fda3b9"
format_stamp: "Formatted at 2026-08-12 20:58:16 on dist-test-slave-h3ft"
server_key: "b0d68601df59ff2c2acb17f26d0a74d5"
server_key_iv: "29737e1e5c3f66de2a0a94253c2a86ad"
server_key_version: "encryptionkey@0"
I20260812 20:58:16.292886 15148 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:16.293953 15174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:16.294193 15148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:16.294328 15148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "89073b6c82104bdfb78191c076fda3b9"
format_stamp: "Formatted at 2026-08-12 20:58:16 on dist-test-slave-h3ft"
server_key: "b0d68601df59ff2c2acb17f26d0a74d5"
server_key_iv: "29737e1e5c3f66de2a0a94253c2a86ad"
server_key_version: "encryptionkey@0"
I20260812 20:58:16.294442 15148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:16.308830 15148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:16.312077 15148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:16.312326 15148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:16.318260 15148 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:33717
I20260812 20:58:16.318312 15260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:33717 every 8 connection(s)
I20260812 20:58:16.319092 15148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:16.320026 15263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:16.323606 15263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9: Bootstrap starting.
I20260812 20:58:16.324462 15263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:16.324849 15263 log.cc:824] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:16.325887 15263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9: No bootstrap required, opened a new log
I20260812 20:58:16.326406 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15148
I20260812 20:58:16.326498 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:16.326735 10361 external_mini_cluster.cc:1428] Setting key 9afcac2bf573d50600e13dd847205eff
I20260812 20:58:16.329731 15263 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89073b6c82104bdfb78191c076fda3b9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33717 } }
I20260812 20:58:16.329931 15263 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:16.329985 15263 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89073b6c82104bdfb78191c076fda3b9, State: Initialized, Role: FOLLOWER
I20260812 20:58:16.330191 15263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89073b6c82104bdfb78191c076fda3b9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33717 } }
I20260812 20:58:16.330302 15263 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:16.330350 15263 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:16.330406 15263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:16.331331 15263 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89073b6c82104bdfb78191c076fda3b9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33717 } }
I20260812 20:58:16.331459 15263 leader_election.cc:302] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89073b6c82104bdfb78191c076fda3b9; no voters:
I20260812 20:58:16.331661 15263 leader_election.cc:288] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:16.331763 15270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:16.331977 15263 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:16.332011 15270 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [term 1 LEADER]: Becoming Leader. State: Replica: 89073b6c82104bdfb78191c076fda3b9, State: Running, Role: LEADER
I20260812 20:58:16.332321 15270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89073b6c82104bdfb78191c076fda3b9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33717 } }
I20260812 20:58:16.333173 15271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89073b6c82104bdfb78191c076fda3b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89073b6c82104bdfb78191c076fda3b9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33717 } } }
I20260812 20:58:16.333280 15271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:16.333751 15276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89073b6c82104bdfb78191c076fda3b9. Latest consensus state: current_term: 1 leader_uuid: "89073b6c82104bdfb78191c076fda3b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89073b6c82104bdfb78191c076fda3b9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33717 } } }
I20260812 20:58:16.333833 15276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9 [sys.catalog]: This master's current role is: LEADER
W20260812 20:58:16.334450 15297 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 20:58:16.334523 15297 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 20:58:16.334628 15288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:16.334858 15288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 20:58:16 dist-test-slave-h3ft krb5kdc[15123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:16.337064 15288 catalog_manager.cc:1347] Generated new cluster ID: 75b9274bd21c4fcc9d8d7d2d33025341
I20260812 20:58:16.337126 15288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:16.341984 15269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:16.327486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55354 (local address 127.10.30.126:33717)
0812 20:58:16.327713 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:16.327722 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:16.327754 (+ 32us) server_negotiation.cc:407] Connection header received
0812 20:58:16.328270 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:16.328279 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:16.328340 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:16.328486 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:16.329560 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:16.330747 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:16.331912 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:16.332624 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:16.332732 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:16.337542 (+ 4810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:16.337548 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:16.337549 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:16.337564 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:16.339760 (+ 2196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:16.340215 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:16.340219 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:16.340219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:16.340341 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:16.340522 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:16.340523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:16.340523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:16.340856 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:16.341022 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:16.341555 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 20:58:16.341718 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":120,"threads_started":1}
I20260812 20:58:16.343461 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 20:58:16.357887 15288 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:16.358614 15288 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:16.362876 15288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89073b6c82104bdfb78191c076fda3b9: Generated new TSK 0
I20260812 20:58:16.363150 15288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 20:58:16.369165 15269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:16.364440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55366 (local address 127.10.30.126:33717)
0812 20:58:16.364530 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:16.364533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:16.364675 (+ 142us) server_negotiation.cc:407] Connection header received
0812 20:58:16.364796 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:16.364797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:16.364807 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:16.364862 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:16.365463 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:16.366025 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:16.367337 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:16.367585 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:16.367648 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:16.368519 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:16.368520 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:16.368521 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:16.368765 (+ 244us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:16.368786 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:16.368792 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:16.368846 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:16.368981 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 20:58:16.369026 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 20:58:16.372824 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15148
2026-08-12T20:58:16Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (3199 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:16 dist-test-slave-h3ft krb5kdc[15318](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:16 dist-test-slave-h3ft krb5kdc[15318](info): set up 2 sockets
Aug 12 20:58:16 dist-test-slave-h3ft krb5kdc[15318](info): commencing operation
krb5kdc: starting...
W20260812 20:58:17.731222 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:17 dist-test-slave-h3ft krb5kdc[15318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:17.896371 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:33733
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:36479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:33733
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:18.001729 15337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:18.002130 15337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:18.002187 15337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:18.003775 15337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:18.003860 15337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:18.003887 15337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:18.003950 15337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:18.003983 15337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:18.006381 15337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:36479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:33733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:33733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:18.007051 15337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:18.007417 15337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:18.014496 15348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:18.014472 15343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:18.014606 15337 server_base.cc:1034] running on GCE node
W20260812 20:58:18.014470 15345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:18.015156 15337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:18.015630 15337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:18.016847 15337 hybrid_clock.cc:648] HybridClock initialized: now 1786568298016825 us; error 58 us; skew 500 ppm
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:18.031072 15337 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:18.031750 15337 webserver.cc:460] Webserver started at http://127.10.30.126:39409/ using document root <none> and password file <none>
I20260812 20:58:18.032080 15337 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:18.032137 15337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:18.032300 15337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:18.033663 15337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "b8248bccd85d4978b051540e2c2ce8ca"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "aae5ce326a284d36c1cf25702ad45006"
server_key_iv: "09a26a9b872de7ab4ecf281a62526887"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.034107 15337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "b8248bccd85d4978b051540e2c2ce8ca"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "aae5ce326a284d36c1cf25702ad45006"
server_key_iv: "09a26a9b872de7ab4ecf281a62526887"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.035944 15337 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 20:58:18.036959 15356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.037247 15337 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:18.037364 15337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "b8248bccd85d4978b051540e2c2ce8ca"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "aae5ce326a284d36c1cf25702ad45006"
server_key_iv: "09a26a9b872de7ab4ecf281a62526887"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.037436 15337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:18.059572 15337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:18.062680 15337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:18.062841 15337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:18.068217 15337 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:33733
I20260812 20:58:18.068293 15441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:33733 every 8 connection(s)
I20260812 20:58:18.068730 15337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:18.070678 15442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:18.073796 15442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca: Bootstrap starting.
I20260812 20:58:18.074637 15442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:18.075066 15442 log.cc:824] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:18.076032 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15337
I20260812 20:58:18.076201 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:18.076285 15442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca: No bootstrap required, opened a new log
I20260812 20:58:18.076455 10361 external_mini_cluster.cc:1428] Setting key 80cfe4184002671cebe50f5a00fe7a2c
I20260812 20:58:18.079312 15442 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8248bccd85d4978b051540e2c2ce8ca" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33733 } }
I20260812 20:58:18.079562 15442 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:18.079617 15442 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8248bccd85d4978b051540e2c2ce8ca, State: Initialized, Role: FOLLOWER
I20260812 20:58:18.079783 15442 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8248bccd85d4978b051540e2c2ce8ca" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33733 } }
I20260812 20:58:18.079905 15442 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:18.079945 15442 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:18.079993 15442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:18.081073 15442 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8248bccd85d4978b051540e2c2ce8ca" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33733 } }
I20260812 20:58:18.081221 15442 leader_election.cc:302] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8248bccd85d4978b051540e2c2ce8ca; no voters:
I20260812 20:58:18.081441 15442 leader_election.cc:288] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:18.081514 15452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:18.081825 15442 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:18.081887 15452 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [term 1 LEADER]: Becoming Leader. State: Replica: b8248bccd85d4978b051540e2c2ce8ca, State: Running, Role: LEADER
I20260812 20:58:18.082264 15452 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8248bccd85d4978b051540e2c2ce8ca" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33733 } }
I20260812 20:58:18.082814 15454 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8248bccd85d4978b051540e2c2ce8ca. Latest consensus state: current_term: 1 leader_uuid: "b8248bccd85d4978b051540e2c2ce8ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8248bccd85d4978b051540e2c2ce8ca" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33733 } } }
I20260812 20:58:18.082916 15454 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:18.083073 15453 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8248bccd85d4978b051540e2c2ce8ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8248bccd85d4978b051540e2c2ce8ca" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33733 } } }
I20260812 20:58:18.083175 15453 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:18.083292 15464 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:18.084007 15464 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:18.086862 15464 catalog_manager.cc:1347] Generated new cluster ID: b67b0b3a71a342a99e8efd6249164725
I20260812 20:58:18.086925 15464 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:18.091984 15451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:18.077177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50006 (local address 127.10.30.126:33733)
0812 20:58:18.077453 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:18.077466 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:18.077520 (+ 54us) server_negotiation.cc:407] Connection header received
0812 20:58:18.078289 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:18.078300 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:18.078390 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:18.078580 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:18.079441 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.081280 (+ 1839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.082890 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.083627 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.083732 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:18.087357 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:18.087362 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:18.087362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:18.087379 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:18.089764 (+ 2385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.090238 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.090242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.090243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.090378 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.090615 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.090616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.090617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.091057 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:18.091255 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:18.091337 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 20:58:18.091507 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":130,"threads_started":1}
I20260812 20:58:18.098596 15464 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:18.099483 15464 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:18.106526 15464 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8248bccd85d4978b051540e2c2ce8ca: Generated new TSK 0
I20260812 20:58:18.106848 15464 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:18.143791 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33733
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:36479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:18.244511 15483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:18.244803 15483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:18.244845 15483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:18.246116 15483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:18.246197 15483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:18.246248 15483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:18.247985 15483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:36479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:18.248317 15483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:18.248612 15483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:18.254788 15490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:18.254788 15493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:18.254806 15495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:18.255317 15483 server_base.cc:1034] running on GCE node
I20260812 20:58:18.255563 15483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:18.255828 15483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:18.257040 15483 hybrid_clock.cc:648] HybridClock initialized: now 1786568298257024 us; error 40 us; skew 500 ppm
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:18.260601 15483 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:18.261256 15483 webserver.cc:460] Webserver started at http://127.10.30.65:41217/ using document root <none> and password file <none>
I20260812 20:58:18.261557 15483 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:18.261636 15483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:18.261806 15483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:18.263208 15483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "f21ae1952f0e4df4ac5c44e156010283"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "6327a7f8310f008872a4ea05d8ea209c"
server_key_iv: "3fa972f7545f20927dfcd0c6b69c140d"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.263651 15483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "f21ae1952f0e4df4ac5c44e156010283"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "6327a7f8310f008872a4ea05d8ea209c"
server_key_iv: "3fa972f7545f20927dfcd0c6b69c140d"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.265305 15483 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 20:58:18.266218 15504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.266436 15483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:18.266592 15483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "f21ae1952f0e4df4ac5c44e156010283"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "6327a7f8310f008872a4ea05d8ea209c"
server_key_iv: "3fa972f7545f20927dfcd0c6b69c140d"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.266681 15483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:18.281538 15483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:18.284317 15483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:18.284543 15483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:18.284854 15483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:18.285256 15483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:18.285315 15483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.285365 15483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:18.285396 15483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.292923 15483 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:38577
I20260812 20:58:18.293051 15690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:38577 every 8 connection(s)
I20260812 20:58:18.293406 15483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:18.302214 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15483
I20260812 20:58:18.302362 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:18.302659 10361 external_mini_cluster.cc:1428] Setting key 490d8dd21b252aa2588ec02ff2c00ab6
I20260812 20:58:18.305713 15451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:18.294496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:60261 (local address 127.10.30.126:33733)
0812 20:58:18.294600 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:18.294603 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:18.294833 (+ 230us) server_negotiation.cc:407] Connection header received
0812 20:58:18.295584 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:18.295586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:18.295601 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:18.295668 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:18.296807 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.297398 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.298508 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.298736 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.298829 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:18.301808 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:18.301810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:18.301810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:18.301819 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:18.303831 (+ 2012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.304392 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.304393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.304394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.304481 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.304807 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.304808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.304809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.304974 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:18.305074 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:18.305459 (+ 385us) server_negotiation.cc:299] Negotiation successful
0812 20:58:18.305592 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:18.306005 15697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:18.294448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33733 (local address 127.10.30.65:60261)
0812 20:58:18.294688 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:18.294732 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:18.295462 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:18.295748 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:18.295753 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:18.296451 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:18.296685 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:18.296690 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.297512 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.297513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:18.298401 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:18.298403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.298843 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.298845 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:18.299080 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:18.299781 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:18.299792 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:18.301627 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:18.303951 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:18.303964 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:18.303967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:18.304292 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:18.304564 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:18.304565 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:18.304566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:18.304725 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:18.305081 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:18.305090 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:18.305283 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 20:58:18.305424 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 20:58:18.305649 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":110,"threads_started":1}
I20260812 20:58:18.306631 15694 heartbeater.cc:347] Connected to a master server at 127.10.30.126:33733
I20260812 20:58:18.306774 15694 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:18.307076 15694 heartbeater.cc:511] Master 127.10.30.126:33733 requested a full tablet report, sending...
I20260812 20:58:18.307775 15382 ts_manager.cc:194] Registered new tserver with Master: f21ae1952f0e4df4ac5c44e156010283 (127.10.30.65:38577)
I20260812 20:58:18.308525 15382 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:60261
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:18.339929 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33733
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:36479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:18.442274 15703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:18.442600 15703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:18.442636 15703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:18.444098 15703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:18.444161 15703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:18.444195 15703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:18.445996 15703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:36479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:18.446353 15703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:18.446679 15703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:18.452946 15717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:18.452901 15711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:18.453028 15710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:18.453105 15703 server_base.cc:1034] running on GCE node
I20260812 20:58:18.453545 15703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:18.453867 15703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:18.455070 15703 hybrid_clock.cc:648] HybridClock initialized: now 1786568298455042 us; error 40 us; skew 500 ppm
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:18.458190 15703 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:18.458789 15703 webserver.cc:460] Webserver started at http://127.10.30.66:44511/ using document root <none> and password file <none>
I20260812 20:58:18.459143 15703 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:18.459221 15703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:18.459412 15703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:18.460750 15703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "d39baa2267fc421da0752bf8fbaf078a"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "02464b6eb11e4f448e81a5feee6432dc"
server_key_iv: "cc184362cd139d3173226a0518e12bc9"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.461199 15703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "d39baa2267fc421da0752bf8fbaf078a"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "02464b6eb11e4f448e81a5feee6432dc"
server_key_iv: "cc184362cd139d3173226a0518e12bc9"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.462944 15703 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 20:58:18.464007 15728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.464260 15703 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:18.464391 15703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "d39baa2267fc421da0752bf8fbaf078a"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "02464b6eb11e4f448e81a5feee6432dc"
server_key_iv: "cc184362cd139d3173226a0518e12bc9"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.464483 15703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:18.475298 15703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:18.477890 15703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:18.478106 15703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:18.478433 15703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:18.478832 15703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:18.478897 15703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.478942 15703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:18.478993 15703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.486996 15703 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:42419
I20260812 20:58:18.487068 15911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:42419 every 8 connection(s)
I20260812 20:58:18.487501 15703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:18.487864 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15703
I20260812 20:58:18.488023 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:18.488293 10361 external_mini_cluster.cc:1428] Setting key 286c61449b34656ea4ab8fd4c44e18f6
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
I20260812 20:58:18.501446 15451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:18.488704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:54945 (local address 127.10.30.126:33733)
0812 20:58:18.488797 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:18.488800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:18.489090 (+ 290us) server_negotiation.cc:407] Connection header received
0812 20:58:18.489983 (+ 893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:18.489985 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:18.490000 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:18.490052 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:18.491917 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.492867 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.494474 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.494697 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.494761 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:18.497943 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:18.497945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:18.497945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:18.497964 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:18.499640 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.500145 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.500147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.500147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.500222 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.500558 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.500559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.500560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.500765 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:18.500870 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:18.501258 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 20:58:18.501351 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 20:58:18.501709 15918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:18.488662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33733 (local address 127.10.30.66:54945)
0812 20:58:18.488885 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:18.488947 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:18.489848 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:18.490161 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:18.490168 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:18.491340 (+ 1172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:18.491728 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:18.491737 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.492991 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.492992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:18.494362 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:18.494367 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.494798 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.494799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:18.494984 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:18.495753 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:18.495767 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:18.497823 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:18.499758 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:18.499768 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:18.499771 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:18.500056 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:18.500304 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:18.500305 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:18.500305 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:18.500457 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:18.500865 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:18.500873 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:18.501095 (+ 222us) client_negotiation.cc:769] Sending connection context
0812 20:58:18.501201 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 20:58:18.501363 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":107,"threads_started":1}
I20260812 20:58:18.502436 15915 heartbeater.cc:347] Connected to a master server at 127.10.30.126:33733
I20260812 20:58:18.502566 15915 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:18.502785 15915 heartbeater.cc:511] Master 127.10.30.126:33733 requested a full tablet report, sending...
I20260812 20:58:18.503332 15382 ts_manager.cc:194] Registered new tserver with Master: d39baa2267fc421da0752bf8fbaf078a (127.10.30.66:42419)
I20260812 20:58:18.503890 15382 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:54945
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:18.528499 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33733
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:36479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:18.630095 15924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:18.630358 15924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:18.630388 15924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:18.631616 15924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:18.631656 15924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:18.631682 15924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:18.633348 15924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:36479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:33733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:18.633594 15924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:18.633816 15924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:18.639496 15936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:18.639534 15935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:18.639537 15938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:18.639752 15924 server_base.cc:1034] running on GCE node
I20260812 20:58:18.640000 15924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:18.640296 15924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:18.641467 15924 hybrid_clock.cc:648] HybridClock initialized: now 1786568298641448 us; error 39 us; skew 500 ppm
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:18.644645 15924 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:18.645159 15924 webserver.cc:460] Webserver started at http://127.10.30.67:39537/ using document root <none> and password file <none>
I20260812 20:58:18.645447 15924 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:18.645529 15924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:18.645695 15924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:18.646993 15924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "8f3c0535ce264082b133239e6e9bd214"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "9192cd525cb892b605a5b7a6340a99d2"
server_key_iv: "36f81a58e846fe347886ad85cf4f54f3"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.647505 15924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "8f3c0535ce264082b133239e6e9bd214"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "9192cd525cb892b605a5b7a6340a99d2"
server_key_iv: "36f81a58e846fe347886ad85cf4f54f3"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.649181 15924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:18.650166 15947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.650445 15924 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:18.650574 15924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "8f3c0535ce264082b133239e6e9bd214"
format_stamp: "Formatted at 2026-08-12 20:58:18 on dist-test-slave-h3ft"
server_key: "9192cd525cb892b605a5b7a6340a99d2"
server_key_iv: "36f81a58e846fe347886ad85cf4f54f3"
server_key_version: "encryptionkey@0"
I20260812 20:58:18.650662 15924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:18.658849 15924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:18.662060 15924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:18.662284 15924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:18.662617 15924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:18.663117 15924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:18.663180 15924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.663232 15924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:18.663264 15924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:18.672116 15924 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:42135
I20260812 20:58:18.672184 16136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:42135 every 8 connection(s)
I20260812 20:58:18.672631 15924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:18.676486 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15924
I20260812 20:58:18.676577 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:18.676805 10361 external_mini_cluster.cc:1428] Setting key bbb8e7787692b89c2f8f9d8c1e20b3f8
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:18.690404 15451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:18.673567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:56613 (local address 127.10.30.126:33733)
0812 20:58:18.673652 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:18.673655 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:18.673917 (+ 262us) server_negotiation.cc:407] Connection header received
0812 20:58:18.674587 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:18.674588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:18.674602 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:18.674676 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:18.676161 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.676821 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.678233 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.678446 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.678508 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:18.686347 (+ 7839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:18.686350 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:18.686351 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:18.686363 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:18.688114 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.688905 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.688907 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.688907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.689015 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.689529 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.689530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.689530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.689697 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:18.689761 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:18.690208 (+ 447us) server_negotiation.cc:299] Negotiation successful
0812 20:58:18.690317 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:18.690696 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:18.673511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33733 (local address 127.10.30.67:56613)
0812 20:58:18.673740 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:18.673793 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:18.674476 (+ 683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:18.674912 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:18.674917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:18.675774 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:18.676032 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:18.676038 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.676969 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.676970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:18.678170 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:18.678173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.678530 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.678531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:18.678646 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:18.684124 (+ 5478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:18.684154 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:18.686190 (+ 2036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:18.688239 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:18.688256 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:18.688260 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:18.688743 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:18.689217 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:18.689219 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:18.689219 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:18.689441 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:18.689800 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:18.689810 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:18.690014 (+ 204us) client_negotiation.cc:769] Sending connection context
0812 20:58:18.690150 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 20:58:18.690341 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":134,"threads_started":1}
I20260812 20:58:18.691411 16137 heartbeater.cc:347] Connected to a master server at 127.10.30.126:33733
I20260812 20:58:18.691562 16137 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:18.691811 16137 heartbeater.cc:511] Master 127.10.30.126:33733 requested a full tablet report, sending...
I20260812 20:58:18.692344 15382 ts_manager.cc:194] Registered new tserver with Master: 8f3c0535ce264082b133239e6e9bd214 (127.10.30.67:42135)
I20260812 20:58:18.692803 15382 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:56613
I20260812 20:58:18.701152 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[15318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568298, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:18.730785 15451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:18.721663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54856 (local address 127.10.30.126:33733)
0812 20:58:18.721789 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:18.721792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:18.721942 (+ 150us) server_negotiation.cc:407] Connection header received
0812 20:58:18.722009 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:18.722010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:18.722030 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:18.722103 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:18.722821 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.723464 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.724320 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:18.724583 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:18.724684 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:18.727639 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:18.727642 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:18.727642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:18.727654 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:18.729259 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.729707 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.729709 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.729709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.729791 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:18.730022 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:18.730023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:18.730024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:18.730248 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:18.730376 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:18.730536 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 20:58:18.730654 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260812 20:58:18.731304 15382 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54856
I20260812 20:58:18.732077 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15483
I20260812 20:58:18.761828 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15703
I20260812 20:58:18.781731 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15924
I20260812 20:58:18.799297 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15337
2026-08-12T20:58:18Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2433 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[16159](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[16159](info): set up 2 sockets
Aug 12 20:58:18 dist-test-slave-h3ft krb5kdc[16159](info): commencing operation
krb5kdc: starting...
W20260812 20:58:20.202950 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.368s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:20 dist-test-slave-h3ft krb5kdc[16159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:20.362908 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:39705
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:39705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:20.462857 16188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:20.463224 16188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:20.463268 16188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:20.464636 16188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:20.464723 16188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:20.464748 16188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:20.464771 16188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:20.464802 16188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:20.466611 16188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:39705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:39705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:20.466967 16188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:20.467290 16188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:20.473249 16198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:20.473229 16194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:20.473237 16195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:20.473732 16188 server_base.cc:1034] running on GCE node
I20260812 20:58:20.474046 16188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:20.474385 16188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:20.475560 16188 hybrid_clock.cc:648] HybridClock initialized: now 1786568300475534 us; error 37 us; skew 500 ppm
Aug 12 20:58:20 dist-test-slave-h3ft krb5kdc[16159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568300, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:20.478914 16188 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:20.479600 16188 webserver.cc:460] Webserver started at http://127.10.30.126:32791/ using document root <none> and password file <none>
I20260812 20:58:20.479887 16188 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:20.479964 16188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:20.480142 16188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:20.481487 16188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "86706733cadd402d912ccc3fa01f6d35"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "cca868a62b78ed3f225317772284c1e0"
server_key_iv: "f6449d106c107a7148923eb3c64ceb11"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.481959 16188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "86706733cadd402d912ccc3fa01f6d35"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "cca868a62b78ed3f225317772284c1e0"
server_key_iv: "f6449d106c107a7148923eb3c64ceb11"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.483785 16188 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:20.484827 16209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:20.485157 16188 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:20.485293 16188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "86706733cadd402d912ccc3fa01f6d35"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "cca868a62b78ed3f225317772284c1e0"
server_key_iv: "f6449d106c107a7148923eb3c64ceb11"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.485417 16188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:20.501008 16188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:20.503942 16188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:20.504149 16188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:20.509598 16188 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:39705
I20260812 20:58:20.509637 16284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:39705 every 8 connection(s)
I20260812 20:58:20.510243 16188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:20.510784 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 16188
I20260812 20:58:20.510923 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:20.511178 10361 external_mini_cluster.cc:1428] Setting key e682428c0152c71508793d5d08aeebca
I20260812 20:58:20.511354 16287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:20.515518 16287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35: Bootstrap starting.
I20260812 20:58:20.516412 16287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:20.516798 16287 log.cc:824] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:20.517753 16287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35: No bootstrap required, opened a new log
Aug 12 20:58:20 dist-test-slave-h3ft krb5kdc[16159](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:20.520424 16287 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86706733cadd402d912ccc3fa01f6d35" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39705 } }
I20260812 20:58:20.520648 16287 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:20.520696 16287 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86706733cadd402d912ccc3fa01f6d35, State: Initialized, Role: FOLLOWER
I20260812 20:58:20.520872 16287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86706733cadd402d912ccc3fa01f6d35" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39705 } }
I20260812 20:58:20.520987 16287 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:20.521031 16287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:20.521087 16287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:20.521957 16287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86706733cadd402d912ccc3fa01f6d35" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39705 } }
I20260812 20:58:20.522087 16287 leader_election.cc:302] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86706733cadd402d912ccc3fa01f6d35; no voters:
I20260812 20:58:20.522289 16287 leader_election.cc:288] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:20.522367 16294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:20.522538 16294 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [term 1 LEADER]: Becoming Leader. State: Replica: 86706733cadd402d912ccc3fa01f6d35, State: Running, Role: LEADER
I20260812 20:58:20.522629 16287 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:20.522691 16294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86706733cadd402d912ccc3fa01f6d35" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39705 } }
I20260812 20:58:20.523092 16294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86706733cadd402d912ccc3fa01f6d35. Latest consensus state: current_term: 1 leader_uuid: "86706733cadd402d912ccc3fa01f6d35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86706733cadd402d912ccc3fa01f6d35" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39705 } } }
I20260812 20:58:20.523104 16298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86706733cadd402d912ccc3fa01f6d35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86706733cadd402d912ccc3fa01f6d35" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39705 } } }
I20260812 20:58:20.523253 16294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:20.523288 16298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:20.523562 16306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:20.525110 16306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:20.525210 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:20.511835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33720 (local address 127.10.30.126:39705)
0812 20:58:20.512092 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:20.512103 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:20.512145 (+ 42us) server_negotiation.cc:407] Connection header received
0812 20:58:20.512843 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:20.512854 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:20.512927 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:20.513112 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:20.513870 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.515350 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.516247 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.516932 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.517064 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:20.520066 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:20.520073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:20.520074 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:20.520092 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:20.522319 (+ 2227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:20.522808 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:20.522812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:20.522812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:20.522934 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:20.523193 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:20.523194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:20.523195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:20.523644 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:20.524713 (+ 1069us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:20.524800 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 20:58:20.524964 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":113,"threads_started":1}
I20260812 20:58:20.527225 16306 catalog_manager.cc:1347] Generated new cluster ID: fde1b1db4a504ef5a9894accda82c4b6
I20260812 20:58:20.527281 16306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:20.552738 16306 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:20.553381 16306 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:20.557467 16306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86706733cadd402d912ccc3fa01f6d35: Generated new TSK 0
I20260812 20:58:20.557730 16306 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:20.595247 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39705
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:20.694710 16338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:20.695046 16338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:20.695096 16338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:20.696619 16338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:20.696688 16338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:20.696738 16338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:20.698648 16338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:20.699030 16338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:20.699353 16338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:20.705720 16343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:20.705720 16346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:20.705720 16348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:20.706051 16338 server_base.cc:1034] running on GCE node
I20260812 20:58:20.706323 16338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:20.706660 16338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:20.707834 16338 hybrid_clock.cc:648] HybridClock initialized: now 1786568300707821 us; error 34 us; skew 500 ppm
Aug 12 20:58:20 dist-test-slave-h3ft krb5kdc[16159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568300, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:20.711326 16338 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:20.711899 16338 webserver.cc:460] Webserver started at http://127.10.30.65:44121/ using document root <none> and password file <none>
I20260812 20:58:20.712203 16338 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:20.712280 16338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:20.712464 16338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:20.713789 16338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "486c708baa3d44aaa7cf178e1b578dba"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "481eab560332cbb0be5ac9bbf2be462a"
server_key_iv: "905835571b8517c9d1b6bafcc5a424e6"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.714258 16338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "486c708baa3d44aaa7cf178e1b578dba"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "481eab560332cbb0be5ac9bbf2be462a"
server_key_iv: "905835571b8517c9d1b6bafcc5a424e6"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.716156 16338 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 20:58:20.717119 16359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:20.717350 16338 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:20.717476 16338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "486c708baa3d44aaa7cf178e1b578dba"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "481eab560332cbb0be5ac9bbf2be462a"
server_key_iv: "905835571b8517c9d1b6bafcc5a424e6"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.717569 16338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:20.731683 16338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:20.734457 16338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:20.734694 16338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:20.735111 16338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:20.735538 16338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:20.735599 16338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:20.735646 16338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:20.735673 16338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:20.743258 16338 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:46779
I20260812 20:58:20.743319 16555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:46779 every 8 connection(s)
I20260812 20:58:20.743736 16338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
Aug 12 20:58:20 dist-test-slave-h3ft krb5kdc[16159](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568300, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:20.753310 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 16338
I20260812 20:58:20.753453 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:20.753679 10361 external_mini_cluster.cc:1428] Setting key 6234817c2918e19a9470e391d8946c00
I20260812 20:58:20.756261 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:20.744757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:46235 (local address 127.10.30.126:39705)
0812 20:58:20.744848 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:20.744850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:20.745065 (+ 215us) server_negotiation.cc:407] Connection header received
0812 20:58:20.746203 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:20.746205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:20.746219 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:20.746290 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:20.747169 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.747769 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.748990 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.749253 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.749325 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:20.752426 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:20.752428 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:20.752429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:20.752438 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:20.754557 (+ 2119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:20.755145 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:20.755147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:20.755148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:20.755221 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:20.755508 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:20.755509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:20.755510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:20.755646 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:20.755724 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:20.756050 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 20:58:20.756158 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 20:58:20.756512 16558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:20.744690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39705 (local address 127.10.30.65:46235)
0812 20:58:20.744895 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:20.744947 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:20.746063 (+ 1116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:20.746388 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:20.746392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:20.746729 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:20.747062 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:20.747067 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.747876 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.747877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:20.748835 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:20.748838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.749345 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.749346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:20.749480 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:20.750246 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:20.750257 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:20.752275 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:20.754665 (+ 2390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:20.754674 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:20.754676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:20.754945 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:20.755294 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:20.755296 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:20.755296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:20.755425 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:20.755723 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:20.755733 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:20.755897 (+ 164us) client_negotiation.cc:769] Sending connection context
0812 20:58:20.756015 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 20:58:20.756207 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":109,"threads_started":1}
I20260812 20:58:20.757165 16556 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39705
I20260812 20:58:20.757300 16556 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:20.757540 16556 heartbeater.cc:511] Master 127.10.30.126:39705 requested a full tablet report, sending...
I20260812 20:58:20.758227 16238 ts_manager.cc:194] Registered new tserver with Master: 486c708baa3d44aaa7cf178e1b578dba (127.10.30.65:46779)
I20260812 20:58:20.758929 16238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:46235
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:20.787581 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39705
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:20.890166 16562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:20.890430 16562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:20.890460 16562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:20.891928 16562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:20.891983 16562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:20.892010 16562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:20.893733 16562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:20.894022 16562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:20.894340 16562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:20.900360 16568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:20.900355 16570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:20.900609 16562 server_base.cc:1034] running on GCE node
W20260812 20:58:20.900360 16574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:20.900947 16562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:20.901297 16562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:20.902568 16562 hybrid_clock.cc:648] HybridClock initialized: now 1786568300902539 us; error 45 us; skew 500 ppm
Aug 12 20:58:20 dist-test-slave-h3ft krb5kdc[16159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568300, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:20.905956 16562 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:20.906484 16562 webserver.cc:460] Webserver started at http://127.10.30.66:43527/ using document root <none> and password file <none>
I20260812 20:58:20.906803 16562 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:20.906857 16562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:20.907091 16562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:20.908421 16562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "7478e41ba4c34b3fa894bcfb5ad543a9"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "32c11a079dab80e5b0129d39fea6444f"
server_key_iv: "156d56382466e5fd97031844c15ee30b"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.908872 16562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "7478e41ba4c34b3fa894bcfb5ad543a9"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "32c11a079dab80e5b0129d39fea6444f"
server_key_iv: "156d56382466e5fd97031844c15ee30b"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.910516 16562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 20:58:20.911542 16589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:20.912101 16562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:20.912231 16562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "7478e41ba4c34b3fa894bcfb5ad543a9"
format_stamp: "Formatted at 2026-08-12 20:58:20 on dist-test-slave-h3ft"
server_key: "32c11a079dab80e5b0129d39fea6444f"
server_key_iv: "156d56382466e5fd97031844c15ee30b"
server_key_version: "encryptionkey@0"
I20260812 20:58:20.912318 16562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:20.950965 16562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:20.953876 16562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:20.954218 16562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:20.954567 16562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:20.954983 16562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:20.955076 16562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:20.955129 16562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:20.955171 16562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:20.962730 16562 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:34857
I20260812 20:58:20.962788 16785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:34857 every 8 connection(s)
I20260812 20:58:20.963296 16562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:20.966320 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 16562
I20260812 20:58:20.966493 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:20.966720 10361 external_mini_cluster.cc:1428] Setting key 18eb302db781aacf9a38b713d48c6e65
Aug 12 20:58:20 dist-test-slave-h3ft krb5kdc[16159](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568300, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:20.975891 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:20.964326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:33181 (local address 127.10.30.126:39705)
0812 20:58:20.964450 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:20.964453 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:20.964705 (+ 252us) server_negotiation.cc:407] Connection header received
0812 20:58:20.965876 (+ 1171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:20.965878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:20.965895 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:20.965949 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:20.966899 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.967662 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.968796 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.969025 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.969123 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:20.972144 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:20.972147 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:20.972148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:20.972158 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:20.974127 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:20.974626 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:20.974628 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:20.974629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:20.974708 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:20.974981 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:20.974982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:20.974983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:20.975219 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:20.975310 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:20.975647 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 20:58:20.975763 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 20:58:20.976061 16790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:20.964294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39705 (local address 127.10.30.66:33181)
0812 20:58:20.964551 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:20.964598 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:20.965734 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:20.966065 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:20.966071 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:20.966401 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:20.966742 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:20.966748 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.967779 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.967781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:20.968690 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:20.968694 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:20.969140 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:20.969141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:20.969312 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:20.970054 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:20.970064 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:20.972012 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:20.974241 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:20.974249 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:20.974252 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:20.974539 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:20.974785 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:20.974785 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:20.974786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:20.974908 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:20.975312 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:20.975319 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:20.975492 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 20:58:20.975596 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 20:58:20.975758 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":119,"threads_started":1}
I20260812 20:58:20.976730 16786 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39705
I20260812 20:58:20.976871 16786 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:20.977139 16786 heartbeater.cc:511] Master 127.10.30.126:39705 requested a full tablet report, sending...
I20260812 20:58:20.977735 16238 ts_manager.cc:194] Registered new tserver with Master: 7478e41ba4c34b3fa894bcfb5ad543a9 (127.10.30.66:34857)
I20260812 20:58:20.978343 16238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:33181
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:21.003271 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39705
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:21.107163 16794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:21.107468 16794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:21.107503 16794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:21.109071 16794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:21.109148 16794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:21.109181 16794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:21.111276 16794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:21.111632 16794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:21.111953 16794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:21.118326 16801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:21.118340 16806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:21.118346 16802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:21.119138 16794 server_base.cc:1034] running on GCE node
I20260812 20:58:21.119429 16794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:21.119755 16794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:21.120911 16794 hybrid_clock.cc:648] HybridClock initialized: now 1786568301120879 us; error 42 us; skew 500 ppm
Aug 12 20:58:21 dist-test-slave-h3ft krb5kdc[16159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568301, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:21.125763 16794 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:21.126461 16794 webserver.cc:460] Webserver started at http://127.10.30.67:45281/ using document root <none> and password file <none>
I20260812 20:58:21.126788 16794 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:21.126894 16794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:21.127121 16794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:21.128603 16794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "44d1d5a7693742adbe1c675fee199d7e"
format_stamp: "Formatted at 2026-08-12 20:58:21 on dist-test-slave-h3ft"
server_key: "5b8e064c70c4422a9f258d30c155edb5"
server_key_iv: "377a80ad45423b324b93bc5a299e603e"
server_key_version: "encryptionkey@0"
I20260812 20:58:21.129099 16794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "44d1d5a7693742adbe1c675fee199d7e"
format_stamp: "Formatted at 2026-08-12 20:58:21 on dist-test-slave-h3ft"
server_key: "5b8e064c70c4422a9f258d30c155edb5"
server_key_iv: "377a80ad45423b324b93bc5a299e603e"
server_key_version: "encryptionkey@0"
I20260812 20:58:21.130990 16794 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 20:58:21.132220 16817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:21.132747 16794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:21.132979 16794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "44d1d5a7693742adbe1c675fee199d7e"
format_stamp: "Formatted at 2026-08-12 20:58:21 on dist-test-slave-h3ft"
server_key: "5b8e064c70c4422a9f258d30c155edb5"
server_key_iv: "377a80ad45423b324b93bc5a299e603e"
server_key_version: "encryptionkey@0"
I20260812 20:58:21.133147 16794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:21.146502 16794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:21.149618 16794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:21.149829 16794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:21.150177 16794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:21.150584 16794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:21.150645 16794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:21.150699 16794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:21.150730 16794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:21.158705 16794 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:38709
I20260812 20:58:21.158756 17005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:38709 every 8 connection(s)
I20260812 20:58:21.159294 16794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:21.161620 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 16794
I20260812 20:58:21.161760 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:21.161998 10361 external_mini_cluster.cc:1428] Setting key 71a42c665aee6800b50fa71aeb7fc79f
Aug 12 20:58:21 dist-test-slave-h3ft krb5kdc[16159](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568301, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:21.171979 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:21.160304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:52683 (local address 127.10.30.126:39705)
0812 20:58:21.160410 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:21.160413 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:21.160634 (+ 221us) server_negotiation.cc:407] Connection header received
0812 20:58:21.162105 (+ 1471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:21.162107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:21.162127 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:21.162221 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:21.163368 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:21.163934 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:21.165271 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:21.165495 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:21.165573 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:21.168596 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:21.168598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:21.168598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:21.168608 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:21.170087 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:21.170602 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:21.170603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:21.170604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:21.170681 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:21.170964 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:21.170965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:21.170966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:21.171294 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:21.171360 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:21.171770 (+ 410us) server_negotiation.cc:299] Negotiation successful
0812 20:58:21.171888 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 20:58:21.172204 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:21.160234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39705 (local address 127.10.30.67:52683)
0812 20:58:21.160467 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:21.160517 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:21.161889 (+ 1372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:21.162341 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:21.162346 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:21.162847 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:21.163270 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:21.163279 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:21.164069 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:21.164070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:21.165132 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:21.165135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:21.165606 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:21.165607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:21.165755 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:21.166533 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:21.166544 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:21.168464 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:21.170199 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:21.170208 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:21.170211 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:21.170500 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:21.170758 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:21.170759 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:21.170759 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:21.170898 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:21.171391 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:21.171400 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:21.171592 (+ 192us) client_negotiation.cc:769] Sending connection context
0812 20:58:21.171710 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 20:58:21.171893 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":118,"threads_started":1}
I20260812 20:58:21.172847 17006 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39705
I20260812 20:58:21.172995 17006 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:21.173254 17006 heartbeater.cc:511] Master 127.10.30.126:39705 requested a full tablet report, sending...
I20260812 20:58:21.173830 16237 ts_manager.cc:194] Registered new tserver with Master: 44d1d5a7693742adbe1c675fee199d7e (127.10.30.67:38709)
I20260812 20:58:21.174211 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:58:21.174433 16237 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:52683
Aug 12 20:58:21 dist-test-slave-h3ft krb5kdc[16159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 20:58:21 dist-test-slave-h3ft krb5kdc[16159](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:58:21.205217 17023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:21.195626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.10.30.65:46779)
0812 20:58:21.195853 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:21.195860 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:21.195872 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:21.195953 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:21.195956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:21.195975 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:21.196070 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:21.196808 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:21.197699 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:21.198661 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:21.199132 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:21.199196 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:21.201942 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:21.201954 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:21.201954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:21.201963 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:21.203967 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:21.204383 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:21.204386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:21.204386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:21.204468 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:21.204657 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:21.204658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:21.204658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:21.204823 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:21.204962 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:21.205041 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 20:58:21.205115 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":121,"threads_started":1}
Aug 12 20:58:21 dist-test-slave-h3ft krb5kdc[16159](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:21.214880 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:21.206932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33730 (local address 127.10.30.126:39705)
0812 20:58:21.207125 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:21.207127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:21.207136 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:21.207162 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:21.207163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:21.207174 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:21.207225 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:21.207734 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:21.208279 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:21.209006 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:21.209199 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:21.209255 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:21.211760 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:21.211762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:21.211762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:21.211771 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:21.213381 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:21.213760 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:21.213762 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:21.213763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:21.213834 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:21.214151 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:21.214152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:21.214153 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:21.214382 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:21.214498 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:21.214613 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 20:58:21.214697 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 20:58:21.215349 16237 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33730
I20260812 20:58:21.215808 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 16338
I20260812 20:58:21.231647 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 16562
I20260812 20:58:21.260560 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 16794
I20260812 20:58:21.286335 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 16188
2026-08-12T20:58:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2481 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:21 dist-test-slave-h3ft krb5kdc[17029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:21 dist-test-slave-h3ft krb5kdc[17029](info): set up 2 sockets
Aug 12 20:58:21 dist-test-slave-h3ft krb5kdc[17029](info): commencing operation
krb5kdc: starting...
W20260812 20:58:22.674228 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.357s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:22 dist-test-slave-h3ft krb5kdc[17029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:22.827443 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35503
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:35503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:22.933691 17051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:22.934087 17051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:22.934145 17051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:22.935727 17051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:22.935851 17051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:22.935882 17051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:22.935906 17051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:22.935945 17051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:22.938089 17051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:35503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:22.938534 17051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:22.938936 17051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:22.945020 17058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:22.945092 17057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:22.945133 17060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:22.945150 17051 server_base.cc:1034] running on GCE node
I20260812 20:58:22.945667 17051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:22.946071 17051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:22.947256 17051 hybrid_clock.cc:648] HybridClock initialized: now 1786568302947247 us; error 41 us; skew 500 ppm
Aug 12 20:58:22 dist-test-slave-h3ft krb5kdc[17029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568302, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:22.950302 17051 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:22.950809 17051 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:22.950893 17051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:22.951112 17051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:22.952451 17051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "eb48d5074da04df490302eecb3f3ccd3"
format_stamp: "Formatted at 2026-08-12 20:58:22 on dist-test-slave-h3ft"
server_key: "c7961e3175592efa12a5cf8521f365a9"
server_key_iv: "6b2f0026394f3aa369a2664e293c29a2"
server_key_version: "encryptionkey@0"
I20260812 20:58:22.952927 17051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "eb48d5074da04df490302eecb3f3ccd3"
format_stamp: "Formatted at 2026-08-12 20:58:22 on dist-test-slave-h3ft"
server_key: "c7961e3175592efa12a5cf8521f365a9"
server_key_iv: "6b2f0026394f3aa369a2664e293c29a2"
server_key_version: "encryptionkey@0"
I20260812 20:58:22.954555 17051 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 20:58:22.955605 17070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:22.955832 17051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:22.955986 17051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "eb48d5074da04df490302eecb3f3ccd3"
format_stamp: "Formatted at 2026-08-12 20:58:22 on dist-test-slave-h3ft"
server_key: "c7961e3175592efa12a5cf8521f365a9"
server_key_iv: "6b2f0026394f3aa369a2664e293c29a2"
server_key_version: "encryptionkey@0"
I20260812 20:58:22.956085 17051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:22.964669 17051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:22.967106 17051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:22.967303 17051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:22.972442 17051 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:35503
I20260812 20:58:22.972470 17157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:35503 every 8 connection(s)
I20260812 20:58:22.972854 17051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:22.974112 17160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:22.975721 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 17051
I20260812 20:58:22.975839 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:22.976100 10361 external_mini_cluster.cc:1428] Setting key edbc341b5f7304d0388fe5af0bd94f83
I20260812 20:58:22.977639 17160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3: Bootstrap starting.
I20260812 20:58:22.978451 17160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:22.978833 17160 log.cc:824] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:22.979707 17160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3: No bootstrap required, opened a new log
I20260812 20:58:22.982409 17160 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb48d5074da04df490302eecb3f3ccd3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35503 } }
I20260812 20:58:22.982643 17160 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:22.982689 17160 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb48d5074da04df490302eecb3f3ccd3, State: Initialized, Role: FOLLOWER
I20260812 20:58:22.982856 17160 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb48d5074da04df490302eecb3f3ccd3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35503 } }
I20260812 20:58:22.982970 17160 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:22.983040 17160 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:22.983096 17160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:22.984005 17160 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb48d5074da04df490302eecb3f3ccd3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35503 } }
I20260812 20:58:22.984120 17160 leader_election.cc:302] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb48d5074da04df490302eecb3f3ccd3; no voters:
I20260812 20:58:22.984376 17160 leader_election.cc:288] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:22.984458 17165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 1 FOLLOWER]: Leader election won for term 1
Aug 12 20:58:22 dist-test-slave-h3ft krb5kdc[17029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:22.984766 17160 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:22.984752 17165 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [term 1 LEADER]: Becoming Leader. State: Replica: eb48d5074da04df490302eecb3f3ccd3, State: Running, Role: LEADER
I20260812 20:58:22.985369 17165 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb48d5074da04df490302eecb3f3ccd3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35503 } }
I20260812 20:58:22.986060 17169 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb48d5074da04df490302eecb3f3ccd3. Latest consensus state: current_term: 1 leader_uuid: "eb48d5074da04df490302eecb3f3ccd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb48d5074da04df490302eecb3f3ccd3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35503 } } }
I20260812 20:58:22.986882 17169 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [sys.catalog]: This master's current role is: LEADER
W20260812 20:58:22.987452 17190 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 20:58:22.987594 17190 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 20:58:22.987624 17166 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb48d5074da04df490302eecb3f3ccd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb48d5074da04df490302eecb3f3ccd3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35503 } } }
I20260812 20:58:22.987763 17166 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:22.987860 17194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:22.988060 17194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:22.990060 17194 catalog_manager.cc:1347] Generated new cluster ID: 1b3e19f218e74a29893438225f88eb75
I20260812 20:58:22.990118 17194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:22.990605 17163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:22.976767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45162 (local address 127.10.30.126:35503)
0812 20:58:22.977031 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:22.977042 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:22.977084 (+ 42us) server_negotiation.cc:407] Connection header received
0812 20:58:22.977687 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:22.977698 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:22.977769 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:22.977928 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:22.978705 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:22.979818 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:22.980983 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:22.981480 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:22.981590 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:22.985328 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:22.985333 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:22.985333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:22.985349 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:22.988381 (+ 3032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:22.988942 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:22.988946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:22.988947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:22.989068 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:22.989360 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:22.989362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:22.989362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:22.989735 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:22.989916 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:22.990218 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 20:58:22.990376 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":120,"threads_started":1}
I20260812 20:58:22.999534 17194 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:23.000245 17194 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:23.006544 17194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3: Generated new TSK 0
I20260812 20:58:23.006821 17194 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:23.056221 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35503
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:23.166937 17198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:23.167299 17198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:23.167335 17198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:23.168797 17198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:23.168840 17198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:23.168871 17198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:23.170666 17198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:23.170939 17198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:23.171298 17198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:23.177608 17208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:23.177664 17206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:23.177631 17205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:23.177773 17198 server_base.cc:1034] running on GCE node
I20260812 20:58:23.178308 17198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:23.178598 17198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:23.179793 17198 hybrid_clock.cc:648] HybridClock initialized: now 1786568303179677 us; error 137 us; skew 500 ppm
Aug 12 20:58:23 dist-test-slave-h3ft krb5kdc[17029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568303, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:23.187714 17198 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:23.188194 17198 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:23.188254 17198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:23.188455 17198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:23.189796 17198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "785c303ba57c4ecbb7f849cfdcfe15f7"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "f1a2cc9dfde60ac62e38483168e7a2a7"
server_key_iv: "ace05f2b0aa12cdd78901e49d35ba804"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.190286 17198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "785c303ba57c4ecbb7f849cfdcfe15f7"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "f1a2cc9dfde60ac62e38483168e7a2a7"
server_key_iv: "ace05f2b0aa12cdd78901e49d35ba804"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.192083 17198 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:23.193126 17222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.193408 17198 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:23.193537 17198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "785c303ba57c4ecbb7f849cfdcfe15f7"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "f1a2cc9dfde60ac62e38483168e7a2a7"
server_key_iv: "ace05f2b0aa12cdd78901e49d35ba804"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.193627 17198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:23.209893 17198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:23.212960 17198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:23.213169 17198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:23.213500 17198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:23.213917 17198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:23.213984 17198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.214032 17198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:23.214064 17198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.221854 17198 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:39665
I20260812 20:58:23.221890 17404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:39665 every 8 connection(s)
I20260812 20:58:23.222240 17198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:58:23.226329 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 17198
I20260812 20:58:23.226543 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:23.226784 10361 external_mini_cluster.cc:1428] Setting key db88e6b7d7cc20ec0412621b42cd888d
Aug 12 20:58:23 dist-test-slave-h3ft krb5kdc[17029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568303, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:23.235311 17163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.223250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:44929 (local address 127.10.30.126:35503)
0812 20:58:23.223313 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.223315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.223623 (+ 308us) server_negotiation.cc:407] Connection header received
0812 20:58:23.224296 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.224298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.224315 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.224387 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:23.225591 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.226326 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.227866 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.228103 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.228193 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.231196 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:23.231198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:23.231198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:23.231209 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:23.233265 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:23.233958 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:23.233960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:23.233960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:23.234043 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:23.234351 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:23.234352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:23.234353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:23.234553 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:23.234640 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.234960 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.235144 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 20:58:23.235414 17409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.223248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:35503 (local address 127.10.30.65:44929)
0812 20:58:23.223470 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:23.223516 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:23.224162 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:23.224480 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:23.224485 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:23.224817 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:23.225457 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.225464 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.226480 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.226481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.227770 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.227774 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.228205 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.228206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.228357 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.229112 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:23.229123 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:23.231075 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:23.233394 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:23.233404 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:23.233406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:23.233855 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:23.234130 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:23.234131 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:23.234131 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:23.234267 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:23.234633 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:23.234639 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:23.234798 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 20:58:23.234902 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 20:58:23.235155 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":97,"threads_started":1}
I20260812 20:58:23.236199 17407 heartbeater.cc:347] Connected to a master server at 127.10.30.126:35503
I20260812 20:58:23.236361 17407 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:23.236583 17407 heartbeater.cc:511] Master 127.10.30.126:35503 requested a full tablet report, sending...
I20260812 20:58:23.237511 17098 ts_manager.cc:194] Registered new tserver with Master: 785c303ba57c4ecbb7f849cfdcfe15f7 (127.10.30.65:39665)
I20260812 20:58:23.238320 17098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:44929
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:23.267673 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35503
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:23.365513 17412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:23.365818 17412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:23.365871 17412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:23.367201 17412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:23.367278 17412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:23.367331 17412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:23.369092 17412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:23.369424 17412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:23.369736 17412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:23.375730 17425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:23.375742 17419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:23.375862 17412 server_base.cc:1034] running on GCE node
W20260812 20:58:23.375763 17420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:23.376224 17412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:23.376544 17412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:23.377731 17412 hybrid_clock.cc:648] HybridClock initialized: now 1786568303377722 us; error 56 us; skew 500 ppm
Aug 12 20:58:23 dist-test-slave-h3ft krb5kdc[17029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568303, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:23.380961 17412 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:23.381445 17412 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:23.381539 17412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:23.381731 17412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:23.383222 17412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "80135d0c5b4742b798c4b491b8f9c572"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "2f31905bb57510c48043c8022c1d06a1"
server_key_iv: "30afb1194dd1638503a1c85fcea621e8"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.383702 17412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "80135d0c5b4742b798c4b491b8f9c572"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "2f31905bb57510c48043c8022c1d06a1"
server_key_iv: "30afb1194dd1638503a1c85fcea621e8"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.385664 17412 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:23.386749 17434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.387060 17412 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:23.387190 17412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "80135d0c5b4742b798c4b491b8f9c572"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "2f31905bb57510c48043c8022c1d06a1"
server_key_iv: "30afb1194dd1638503a1c85fcea621e8"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.387284 17412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:23.414927 17412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:23.418057 17412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:23.418305 17412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:23.418640 17412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:23.419090 17412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:23.419157 17412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.419198 17412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:23.419248 17412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.427083 17412 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:38425
I20260812 20:58:23.427172 17631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:38425 every 8 connection(s)
I20260812 20:58:23.427634 17412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
Aug 12 20:58:23 dist-test-slave-h3ft krb5kdc[17029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568303, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:23.436391 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 17412
I20260812 20:58:23.436525 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:23.436791 10361 external_mini_cluster.cc:1428] Setting key 051bba719f5f3aeeaa69e22806372c8b
I20260812 20:58:23.440618 17163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.428713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:49869 (local address 127.10.30.126:35503)
0812 20:58:23.428810 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.428813 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.429122 (+ 309us) server_negotiation.cc:407] Connection header received
0812 20:58:23.429757 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.429759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.429773 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.429837 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:23.431134 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.431740 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.432988 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.433217 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.433283 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.436234 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:23.436236 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:23.436236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:23.436244 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:23.438533 (+ 2289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:23.439249 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:23.439251 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:23.439251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:23.439321 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:23.439677 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:23.439678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:23.439678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:23.439820 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:23.439880 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.440310 (+ 430us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.440458 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:23.440866 17636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.428693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:35503 (local address 127.10.30.66:49869)
0812 20:58:23.428931 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:23.429017 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:23.429647 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:23.429923 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:23.429927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:23.430313 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:23.430965 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.430972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.431908 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.431908 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.432879 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.432882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.433313 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.433314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.433434 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.434168 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:23.434178 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:23.435892 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:23.438643 (+ 2751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:23.438657 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:23.438661 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:23.439144 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:23.439398 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:23.439399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:23.439400 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:23.439588 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:23.439893 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:23.439900 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:23.440128 (+ 228us) client_negotiation.cc:769] Sending connection context
0812 20:58:23.440256 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 20:58:23.440502 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":118,"threads_started":1}
I20260812 20:58:23.441501 17633 heartbeater.cc:347] Connected to a master server at 127.10.30.126:35503
I20260812 20:58:23.441655 17633 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:23.441866 17633 heartbeater.cc:511] Master 127.10.30.126:35503 requested a full tablet report, sending...
I20260812 20:58:23.442370 17098 ts_manager.cc:194] Registered new tserver with Master: 80135d0c5b4742b798c4b491b8f9c572 (127.10.30.66:38425)
I20260812 20:58:23.442821 17098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:49869
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:23.476431 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35503
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:23.577488 17639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:23.577831 17639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:23.577879 17639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:23.579344 17639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:23.579429 17639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:23.579481 17639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:23.581423 17639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:35503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:23.581811 17639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:23.582147 17639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 20:58:23.589044 17639 server_base.cc:1034] running on GCE node
W20260812 20:58:23.589042 17649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:23.589004 17651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:23.589004 17655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:23.589632 17639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:23.589983 17639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:23.591226 17639 hybrid_clock.cc:648] HybridClock initialized: now 1786568303591194 us; error 46 us; skew 500 ppm
Aug 12 20:58:23 dist-test-slave-h3ft krb5kdc[17029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568303, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:23.594715 17639 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:23.595243 17639 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:23.595329 17639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:23.595510 17639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:23.596959 17639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "5eec698d58b94e2ebafedb9362d5fbd2"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "27dd8b2859ca4392b01efb20fe1b11b5"
server_key_iv: "45bc28f53d7acf31e8f253cc4b14accf"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.597474 17639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "5eec698d58b94e2ebafedb9362d5fbd2"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "27dd8b2859ca4392b01efb20fe1b11b5"
server_key_iv: "45bc28f53d7acf31e8f253cc4b14accf"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.599354 17639 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:23.600446 17664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.600776 17639 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:23.600935 17639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "5eec698d58b94e2ebafedb9362d5fbd2"
format_stamp: "Formatted at 2026-08-12 20:58:23 on dist-test-slave-h3ft"
server_key: "27dd8b2859ca4392b01efb20fe1b11b5"
server_key_iv: "45bc28f53d7acf31e8f253cc4b14accf"
server_key_version: "encryptionkey@0"
I20260812 20:58:23.601068 17639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:23.612659 17639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:23.616453 17639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:23.616698 17639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:23.617055 17639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:23.617483 17639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:23.617558 17639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.617625 17639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:23.617655 17639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:23.625527 17639 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:35973
I20260812 20:58:23.625566 17854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:35973 every 8 connection(s)
I20260812 20:58:23.625939 17639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
Aug 12 20:58:23 dist-test-slave-h3ft krb5kdc[17029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568303, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:23.635129 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 17639
I20260812 20:58:23.635272 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:23.635550 10361 external_mini_cluster.cc:1428] Setting key 0df7a10273e069b89a34d10ad4313b9f
I20260812 20:58:23.638048 17163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.626881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:55341 (local address 127.10.30.126:35503)
0812 20:58:23.626973 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.626976 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.627289 (+ 313us) server_negotiation.cc:407] Connection header received
0812 20:58:23.627893 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.627894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.627908 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.627983 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:23.629184 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.629754 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.630978 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.631232 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.631302 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.634172 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:23.634174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:23.634174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:23.634184 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:23.636219 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:23.636916 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:23.636917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:23.636918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:23.637032 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:23.637328 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:23.637328 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:23.637329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:23.637474 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:23.637535 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.637848 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.637929 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:23.638419 17858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.626868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:35503 (local address 127.10.30.67:55341)
0812 20:58:23.627136 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:23.627184 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:23.627776 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:23.628096 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:23.628100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:23.628433 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:23.629056 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.629062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.629857 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.629858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.630784 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.630786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.631340 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.631341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.631473 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.632150 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:23.632160 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:23.634043 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:23.636364 (+ 2321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:23.636376 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:23.636379 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:23.636807 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:23.637129 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:23.637130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:23.637130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:23.637261 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:23.637545 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:23.637552 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:23.637709 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 20:58:23.637810 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 20:58:23.637986 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":149,"threads_started":1}
I20260812 20:58:23.639194 17855 heartbeater.cc:347] Connected to a master server at 127.10.30.126:35503
I20260812 20:58:23.639309 17855 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:23.639531 17855 heartbeater.cc:511] Master 127.10.30.126:35503 requested a full tablet report, sending...
I20260812 20:58:23.640056 17098 ts_manager.cc:194] Registered new tserver with Master: 5eec698d58b94e2ebafedb9362d5fbd2 (127.10.30.67:35973)
I20260812 20:58:23.640534 17098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:55341
I20260812 20:58:23.648144 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:58:23.657539 17163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.649890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45170 (local address 127.10.30.126:35503)
0812 20:58:23.650010 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.650018 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.650090 (+ 72us) server_negotiation.cc:407] Connection header received
0812 20:58:23.650187 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.650188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.650209 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.650285 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:23.651125 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.651705 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.652545 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.652790 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.652898 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.654416 (+ 1518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:23.654419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:23.654419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:23.654428 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:23.656055 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:23.656489 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:23.656490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:23.656490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:23.656558 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:23.656786 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:23.656787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:23.656788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:23.656996 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:23.657127 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.657310 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.657411 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 20:58:23.659813 17098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:23.662317 17098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:23.671253 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.665817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:38425 (local address 127.0.0.1:33636)
0812 20:58:23.666539 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:23.666579 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:23.666690 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:23.666985 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:23.666990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:23.666993 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:23.667144 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.667147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.668636 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.668637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.669673 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.669676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.670837 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.670839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.670946 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.670963 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 20:58:23.671077 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 20:58:23.671148 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":25,"thread_start_us":77,"threads_started":1}
I20260812 20:58:23.671269 17871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.666013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33636 (local address 127.10.30.66:38425)
0812 20:58:23.666336 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.666343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.666676 (+ 333us) server_negotiation.cc:407] Connection header received
0812 20:58:23.666798 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.666801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.666821 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.666920 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:23.667265 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.668506 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.669793 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.670617 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.670704 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.670779 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.671101 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.671153 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":105,"threads_started":1}
I20260812 20:58:23.671489 17873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.666038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49508 (local address 127.10.30.67:35973)
0812 20:58:23.666435 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.666439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.666962 (+ 523us) server_negotiation.cc:407] Connection header received
0812 20:58:23.667054 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.667057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.667078 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.667193 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:23.667337 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.668969 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.670220 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.670926 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.671053 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.671121 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.671276 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.671321 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":120,"threads_started":1}
I20260812 20:58:23.671391 17869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.665818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:35973 (local address 127.0.0.1:49508)
0812 20:58:23.666816 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:23.666825 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:23.666889 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:23.667204 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:23.667204 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:23.667207 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:23.667277 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.667279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.669093 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.669094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.670133 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.670135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.671084 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.671085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.671158 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.671163 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:23.671257 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 20:58:23.671303 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"mutex_wait_us":6,"thread_start_us":130,"threads_started":1}
I20260812 20:58:23.671904 17875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.666120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:39665 (local address 127.0.0.1:47614)
0812 20:58:23.667143 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:23.667174 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:23.667266 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:23.667565 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:23.667566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:23.667567 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:23.667602 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.667603 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.668560 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.668561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.669938 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.669941 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.671466 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.671467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.671738 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.671743 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:23.671793 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 20:58:23.671840 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1005,"mutex_wait_us":64,"thread_start_us":104,"threads_started":1}
I20260812 20:58:23.672008 17877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.666308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47614 (local address 127.10.30.65:39665)
0812 20:58:23.667087 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.667092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.667236 (+ 144us) server_negotiation.cc:407] Connection header received
0812 20:58:23.667365 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.667367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.667384 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.667446 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:23.667716 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.668438 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.670058 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.670851 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.670929 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.670996 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.671827 (+ 831us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.671883 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":736,"thread_start_us":104,"threads_started":1}
I20260812 20:58:23.672446 17735 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd9dcaa02b74b08953dcbbf4355b498 (DEFAULT_TABLE table=test-table [id=7673a3b5d89b4685b630e00d4cd21c5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:23.672447 17521 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd9dcaa02b74b08953dcbbf4355b498 (DEFAULT_TABLE table=test-table [id=7673a3b5d89b4685b630e00d4cd21c5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:23.672960 17735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd9dcaa02b74b08953dcbbf4355b498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:23.672960 17521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd9dcaa02b74b08953dcbbf4355b498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:23.675905 17298 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd9dcaa02b74b08953dcbbf4355b498 (DEFAULT_TABLE table=test-table [id=7673a3b5d89b4685b630e00d4cd21c5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:23.676358 17298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd9dcaa02b74b08953dcbbf4355b498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:23.677596 17879 tablet_bootstrap.cc:492] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Bootstrap starting.
I20260812 20:58:23.677702 17878 tablet_bootstrap.cc:492] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Bootstrap starting.
I20260812 20:58:23.678558 17878 tablet_bootstrap.cc:654] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:23.678558 17879 tablet_bootstrap.cc:654] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:23.679394 17878 log.cc:824] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:23.679394 17879 log.cc:824] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:23.680491 17878 tablet_bootstrap.cc:492] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: No bootstrap required, opened a new log
I20260812 20:58:23.680586 17878 ts_tablet_manager.cc:1397] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:58:23.680716 17879 tablet_bootstrap.cc:492] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: No bootstrap required, opened a new log
I20260812 20:58:23.680788 17879 ts_tablet_manager.cc:1397] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:58:23.683182 17883 tablet_bootstrap.cc:492] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7: Bootstrap starting.
I20260812 20:58:23.683029 17878 raft_consensus.cc:348] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.683099 17879 raft_consensus.cc:348] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.683267 17879 raft_consensus.cc:374] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:23.683266 17878 raft_consensus.cc:374] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:23.683306 17878 raft_consensus.cc:729] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec698d58b94e2ebafedb9362d5fbd2, State: Initialized, Role: FOLLOWER
I20260812 20:58:23.683306 17879 raft_consensus.cc:729] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80135d0c5b4742b798c4b491b8f9c572, State: Initialized, Role: FOLLOWER
I20260812 20:58:23.683457 17879 consensus_queue.cc:260] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.683588 17878 consensus_queue.cc:260] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.683876 17879 ts_tablet_manager.cc:1428] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 20:58:23.683912 17633 heartbeater.cc:503] Master 127.10.30.126:35503 was elected leader, sending a full tablet report...
I20260812 20:58:23.684141 17883 tablet_bootstrap.cc:654] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:23.684228 17878 ts_tablet_manager.cc:1428] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 20:58:23.684372 17855 heartbeater.cc:503] Master 127.10.30.126:35503 was elected leader, sending a full tablet report...
I20260812 20:58:23.685029 17883 log.cc:824] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:23.686286 17883 tablet_bootstrap.cc:492] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7: No bootstrap required, opened a new log
I20260812 20:58:23.686354 17883 ts_tablet_manager.cc:1397] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260812 20:58:23.688184 17883 raft_consensus.cc:348] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.688349 17883 raft_consensus.cc:374] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:23.688372 17883 raft_consensus.cc:729] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 785c303ba57c4ecbb7f849cfdcfe15f7, State: Initialized, Role: FOLLOWER
I20260812 20:58:23.688525 17883 consensus_queue.cc:260] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.688841 17883 ts_tablet_manager.cc:1428] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 20:58:23.688894 17407 heartbeater.cc:503] Master 127.10.30.126:35503 was elected leader, sending a full tablet report...
W20260812 20:58:23.723251 17408 tablet.cc:2369] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 20:58:23.876744 17856 tablet.cc:2369] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:23.923815 17887 raft_consensus.cc:482] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:23.924037 17887 raft_consensus.cc:504] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.924655 17887 leader_election.cc:288] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eec698d58b94e2ebafedb9362d5fbd2 (127.10.30.67:35973), 80135d0c5b4742b798c4b491b8f9c572 (127.10.30.66:38425)
I20260812 20:58:23.928330 17873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.925114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:52613 (local address 127.10.30.67:35973)
0812 20:58:23.925179 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.925181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.925197 (+ 16us) server_negotiation.cc:407] Connection header received
0812 20:58:23.925309 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.925310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.925325 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.925412 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:23.925614 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.926150 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.927452 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.927896 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.927997 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.928008 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.928187 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.928233 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 20:58:23.928366 17889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.924947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:35973 (local address 127.10.30.65:52613)
0812 20:58:23.925126 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:23.925142 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:23.925223 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:23.925424 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:23.925425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:23.925427 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:23.925533 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.925535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.926260 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.926262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.927329 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.927332 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.927998 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.927999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.928090 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.928093 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 20:58:23.928162 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 20:58:23.928215 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":74,"thread_start_us":93,"threads_started":1}
I20260812 20:58:23.928341 17871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.925069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:55763 (local address 127.10.30.66:38425)
0812 20:58:23.925154 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.925156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.925234 (+ 78us) server_negotiation.cc:407] Connection header received
0812 20:58:23.925301 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.925302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.925316 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.925400 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:23.925615 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.926150 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.927458 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.927883 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.927986 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.928000 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.928165 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.928216 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 20:58:23.928525 17634 tablet.cc:2369] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:23.928926 17888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.924942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:38425 (local address 127.10.30.65:55763)
0812 20:58:23.925126 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:23.925142 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:23.925225 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:23.925420 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:23.925422 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:23.925424 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:23.925523 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.925525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.926261 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.926262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.927347 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:23.927350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.927985 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.927986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:23.928078 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.928083 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:23.928157 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 20:58:23.928215 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":65,"thread_start_us":85,"threads_started":1}
I20260812 20:58:23.929315 17770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd9dcaa02b74b08953dcbbf4355b498" candidate_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" is_pre_election: true
I20260812 20:58:23.929386 17562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd9dcaa02b74b08953dcbbf4355b498" candidate_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80135d0c5b4742b798c4b491b8f9c572" is_pre_election: true
I20260812 20:58:23.929572 17562 raft_consensus.cc:2454] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 785c303ba57c4ecbb7f849cfdcfe15f7 in term 0.
I20260812 20:58:23.929574 17770 raft_consensus.cc:2454] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 785c303ba57c4ecbb7f849cfdcfe15f7 in term 0.
I20260812 20:58:23.929953 17228 leader_election.cc:302] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 785c303ba57c4ecbb7f849cfdcfe15f7, 80135d0c5b4742b798c4b491b8f9c572; no voters:
I20260812 20:58:23.930227 17887 raft_consensus.cc:2781] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:23.930313 17887 raft_consensus.cc:482] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:23.930378 17887 raft_consensus.cc:3037] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:23.931449 17887 raft_consensus.cc:504] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.931710 17887 leader_election.cc:288] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [CANDIDATE]: Term 1 election: Requested vote from peers 5eec698d58b94e2ebafedb9362d5fbd2 (127.10.30.67:35973), 80135d0c5b4742b798c4b491b8f9c572 (127.10.30.66:38425)
I20260812 20:58:23.932035 17770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd9dcaa02b74b08953dcbbf4355b498" candidate_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec698d58b94e2ebafedb9362d5fbd2"
I20260812 20:58:23.932060 17562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd9dcaa02b74b08953dcbbf4355b498" candidate_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80135d0c5b4742b798c4b491b8f9c572"
I20260812 20:58:23.932181 17770 raft_consensus.cc:3037] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:23.932180 17562 raft_consensus.cc:3037] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:23.933435 17562 raft_consensus.cc:2454] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 785c303ba57c4ecbb7f849cfdcfe15f7 in term 1.
I20260812 20:58:23.933436 17770 raft_consensus.cc:2454] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 785c303ba57c4ecbb7f849cfdcfe15f7 in term 1.
I20260812 20:58:23.933763 17225 leader_election.cc:302] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eec698d58b94e2ebafedb9362d5fbd2, 785c303ba57c4ecbb7f849cfdcfe15f7; no voters:
I20260812 20:58:23.933964 17887 raft_consensus.cc:2781] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:23.934212 17887 raft_consensus.cc:686] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [term 1 LEADER]: Becoming Leader. State: Replica: 785c303ba57c4ecbb7f849cfdcfe15f7, State: Running, Role: LEADER
I20260812 20:58:23.934363 17887 consensus_queue.cc:237] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } }
I20260812 20:58:23.935622 17097 catalog_manager.cc:5495] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 785c303ba57c4ecbb7f849cfdcfe15f7 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "785c303ba57c4ecbb7f849cfdcfe15f7" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39665 } health_report { overall_health: HEALTHY } } }
I20260812 20:58:23.957388 17877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:23.954414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47620 (local address 127.10.30.65:39665)
0812 20:58:23.954512 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:23.954514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:23.954524 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:23.954584 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:23.954585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:23.954611 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:23.954700 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:23.954891 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.955542 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.956413 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:23.956630 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:23.956717 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:23.956942 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:23.957090 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:23.957201 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:23.957221 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 20:58:23.957248 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 20:58:23.960781 17562 raft_consensus.cc:1261] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 1 FOLLOWER]: Refusing update from remote peer 785c303ba57c4ecbb7f849cfdcfe15f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:23.960781 17770 raft_consensus.cc:1261] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 1 FOLLOWER]: Refusing update from remote peer 785c303ba57c4ecbb7f849cfdcfe15f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:23.961409 17887 consensus_queue.cc:1035] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80135d0c5b4742b798c4b491b8f9c572" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 38425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:23.961630 17892 consensus_queue.cc:1035] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec698d58b94e2ebafedb9362d5fbd2" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:23.966434 17900 mvcc.cc:205] Tried to move back new op lower bound from 7317783773017862144 to 7317783772915957760. Current Snapshot: MvccSnapshot[applied={T|T < 7317783773017862144 or (T in {7317783773017862144})}]
I20260812 20:58:23.968637 17098 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:23.968803 17098 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:23.969907 17098 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb48d5074da04df490302eecb3f3ccd3: Sending DeleteTablet for 3 replicas of tablet 5cd9dcaa02b74b08953dcbbf4355b498
I20260812 20:58:23.970461 17735 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cd9dcaa02b74b08953dcbbf4355b498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:23 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:49508
I20260812 20:58:23.970438 17521 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cd9dcaa02b74b08953dcbbf4355b498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:23 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:33636
I20260812 20:58:23.970894 17298 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cd9dcaa02b74b08953dcbbf4355b498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:23 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:47614
I20260812 20:58:23.971135 17914 tablet_replica.cc:330] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: stopping tablet replica
I20260812 20:58:23.971226 17915 tablet_replica.cc:330] T 5cd9dcaa02b74b08953dcbbf4355b498 P 785c303ba57c4ecbb7f849cfdcfe15f7: stopping tablet replica
I20260812 20:58:23.971309 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 17198
I20260812 20:58:23.971323 17914 raft_consensus.cc:2229] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:23.980998 17914 raft_consensus.cc:2258] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:23.985227 17914 ts_tablet_manager.cc:1905] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:23.987669 17913 tablet_replica.cc:330] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: stopping tablet replica
I20260812 20:58:23.987864 17913 raft_consensus.cc:2229] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:23.988021 17913 raft_consensus.cc:2258] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:23.988229 17914 ts_tablet_manager.cc:1918] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:23.988313 17914 log.cc:1196] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/5cd9dcaa02b74b08953dcbbf4355b498
I20260812 20:58:23.988618 17914 ts_tablet_manager.cc:1939] T 5cd9dcaa02b74b08953dcbbf4355b498 P 5eec698d58b94e2ebafedb9362d5fbd2: Deleting consensus metadata
I20260812 20:58:23.989526 17075 catalog_manager.cc:4841] TS 5eec698d58b94e2ebafedb9362d5fbd2 (127.10.30.67:35973): tablet 5cd9dcaa02b74b08953dcbbf4355b498 (table test-table [id=7673a3b5d89b4685b630e00d4cd21c5c]) successfully deleted
I20260812 20:58:23.989956 17913 ts_tablet_manager.cc:1905] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:23.992203 17913 ts_tablet_manager.cc:1918] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:23.992296 17913 log.cc:1196] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/5cd9dcaa02b74b08953dcbbf4355b498
I20260812 20:58:23.992544 17913 ts_tablet_manager.cc:1939] T 5cd9dcaa02b74b08953dcbbf4355b498 P 80135d0c5b4742b798c4b491b8f9c572: Deleting consensus metadata
I20260812 20:58:23.996147 17078 catalog_manager.cc:4841] TS 80135d0c5b4742b798c4b491b8f9c572 (127.10.30.66:38425): tablet 5cd9dcaa02b74b08953dcbbf4355b498 (table test-table [id=7673a3b5d89b4685b630e00d4cd21c5c]) successfully deleted
W20260812 20:58:24.002497 17075 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:39665 (error 108)
I20260812 20:58:24.002799 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 17412
I20260812 20:58:24.035209 17875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.034912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:39665 (local address 127.0.0.1:47626)
0812 20:58:24.035038 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.035129 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 20:58:24.035524 17075 catalog_manager.cc:4584] TS 785c303ba57c4ecbb7f849cfdcfe15f7 (127.10.30.65:39665): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5cd9dcaa02b74b08953dcbbf4355b498: Network error: Client connection negotiation failed: client connection to 127.10.30.65:39665: connect: Connection refused (error 111)
I20260812 20:58:24.041222 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 17639
I20260812 20:58:24.060655 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 17051
2026-08-12T20:58:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2785 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T20:58:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:24Z Disabled control of system clock
I20260812 20:58:24.115322 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:40371
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:41211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:40371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 20:58:24.215853 17928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:24.216171 17928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:24.216207 17928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:24.217537 17928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:24.217630 17928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:24.217651 17928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:24.217674 17928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:24.217702 17928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:24.219323 17928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:41211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:40371
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:40371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:24.219682 17928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:24.220081 17928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:24.226056 17936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:24.226218 17935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:24.226454 17928 server_base.cc:1034] running on GCE node
W20260812 20:58:24.226569 17940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:24.226940 17928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:24.227365 17928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:24.228535 17928 hybrid_clock.cc:648] HybridClock initialized: now 1786568304228522 us; error 36 us; skew 500 ppm
I20260812 20:58:24.230214 17928 webserver.cc:460] Webserver started at http://127.10.30.126:44069/ using document root <none> and password file <none>
I20260812 20:58:24.230551 17928 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:24.230634 17928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:24.230810 17928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:24.232167 17928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "66bf38d832f840fa9226359653832605"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "605976c1724955bc7aef5d4c5a676085"
server_key_iv: "9f0a70925f3c542429b811343f27a88e"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.232620 17928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "66bf38d832f840fa9226359653832605"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "605976c1724955bc7aef5d4c5a676085"
server_key_iv: "9f0a70925f3c542429b811343f27a88e"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.234283 17928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:24.235406 17949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.235637 17928 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:24.235767 17928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "66bf38d832f840fa9226359653832605"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "605976c1724955bc7aef5d4c5a676085"
server_key_iv: "9f0a70925f3c542429b811343f27a88e"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.235858 17928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:24.239816 17928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:24.240149 17928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:24.240307 17928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:24.245254 17928 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:40371
I20260812 20:58:24.245324 18037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:40371 every 8 connection(s)
I20260812 20:58:24.245743 17928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:24.246579 18038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:24.247033 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 17928
I20260812 20:58:24.247155 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:24.247403 10361 external_mini_cluster.cc:1428] Setting key 4a735ceb58637f9650c57766704d4aaf
I20260812 20:58:24.251091 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.248244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33880 (local address 127.10.30.126:40371)
0812 20:58:24.248519 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.248530 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.248564 (+ 34us) server_negotiation.cc:407] Connection header received
0812 20:58:24.249246 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.249256 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.249312 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.249493 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.250411 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.250415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.250415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.250420 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.250480 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.250494 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.250572 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.250708 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.250826 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":131,"threads_started":1}
I20260812 20:58:24.251575 18038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605: Bootstrap starting.
I20260812 20:58:24.252400 18038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:24.252782 18038 log.cc:824] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:24.253643 18038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605: No bootstrap required, opened a new log
I20260812 20:58:24.255426 18038 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bf38d832f840fa9226359653832605" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40371 } }
I20260812 20:58:24.255590 18038 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:24.255615 18038 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66bf38d832f840fa9226359653832605, State: Initialized, Role: FOLLOWER
I20260812 20:58:24.255785 18038 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bf38d832f840fa9226359653832605" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40371 } }
I20260812 20:58:24.255879 18038 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:24.255905 18038 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:24.255985 18038 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:24.256827 18038 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bf38d832f840fa9226359653832605" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40371 } }
I20260812 20:58:24.256981 18038 leader_election.cc:302] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66bf38d832f840fa9226359653832605; no voters:
I20260812 20:58:24.257186 18038 leader_election.cc:288] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:24.257241 18048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:24.257449 18048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [term 1 LEADER]: Becoming Leader. State: Replica: 66bf38d832f840fa9226359653832605, State: Running, Role: LEADER
I20260812 20:58:24.257596 18038 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:24.257599 18048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bf38d832f840fa9226359653832605" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40371 } }
I20260812 20:58:24.258150 18052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66bf38d832f840fa9226359653832605. Latest consensus state: current_term: 1 leader_uuid: "66bf38d832f840fa9226359653832605" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bf38d832f840fa9226359653832605" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40371 } } }
I20260812 20:58:24.258124 18050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66bf38d832f840fa9226359653832605" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bf38d832f840fa9226359653832605" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40371 } } }
I20260812 20:58:24.258252 18052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:24.258255 18050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:24.258868 18060 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:24.259629 18060 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:24.261610 18060 catalog_manager.cc:1347] Generated new cluster ID: 399f086354a84fd3a129955cc873f8a7
I20260812 20:58:24.261689 18060 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:24.279932 18060 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:24.280220 18060 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:24.289357 18060 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605: Generated new TSK 0
I20260812 20:58:24.289652 18060 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 20:58:24.296388 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40371
--builtin_ntp_servers=127.10.30.84:41211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 20:58:24.411870 18076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:24.412184 18076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:24.412228 18076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:24.413587 18076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:24.413668 18076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:24.413714 18076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:24.415335 18076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:41211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:24.415695 18076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:24.416096 18076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:24.422957 18083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:24.423157 18085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:24.422961 18082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:24.423556 18076 server_base.cc:1034] running on GCE node
I20260812 20:58:24.423822 18076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:24.424160 18076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:24.425356 18076 hybrid_clock.cc:648] HybridClock initialized: now 1786568304425333 us; error 58 us; skew 500 ppm
I20260812 20:58:24.427117 18076 webserver.cc:460] Webserver started at http://127.10.30.65:39505/ using document root <none> and password file <none>
I20260812 20:58:24.427451 18076 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:24.427525 18076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:24.427686 18076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:24.429071 18076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "afe928707cee4145b3b9d559bf131fad"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "e6c0aedfee270a21d486df84f43ba256"
server_key_iv: "2f5c3bf8d5b1adf0c09dbd521edc5136"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.429440 18076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "afe928707cee4145b3b9d559bf131fad"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "e6c0aedfee270a21d486df84f43ba256"
server_key_iv: "2f5c3bf8d5b1adf0c09dbd521edc5136"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.431118 18076 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:24.432161 18096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.432551 18076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:24.432667 18076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "afe928707cee4145b3b9d559bf131fad"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "e6c0aedfee270a21d486df84f43ba256"
server_key_iv: "2f5c3bf8d5b1adf0c09dbd521edc5136"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.432796 18076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:24.437183 18076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:24.437541 18076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:24.437712 18076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:24.437973 18076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:24.438359 18076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:24.438421 18076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.438457 18076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:24.438488 18076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.446673 18076 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:44237
I20260812 20:58:24.446730 18288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:44237 every 8 connection(s)
I20260812 20:58:24.447305 18076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:58:24.451550 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.448378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:60083 (local address 127.10.30.126:40371)
0812 20:58:24.448478 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.448481 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.448808 (+ 327us) server_negotiation.cc:407] Connection header received
0812 20:58:24.449496 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.449497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.449506 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.449586 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.451250 (+ 1664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.451252 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.451253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.451259 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.451280 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.451285 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.451346 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.451451 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.451472 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 20:58:24.451972 18293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.448373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:40371 (local address 127.10.30.65:60083)
0812 20:58:24.448644 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.448688 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:24.449353 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:24.449704 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:24.449708 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:24.449718 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:24.451058 (+ 1340us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:58:24.451059 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:24.451098 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:58:24.451135 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:24.451363 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:24.451368 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:24.451372 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:24.451445 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 20:58:24.451512 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":161,"threads_started":1}
I20260812 20:58:24.452942 18290 heartbeater.cc:347] Connected to a master server at 127.10.30.126:40371
I20260812 20:58:24.453069 18290 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:24.453295 18290 heartbeater.cc:511] Master 127.10.30.126:40371 requested a full tablet report, sending...
I20260812 20:58:24.454156 17973 ts_manager.cc:194] Registered new tserver with Master: afe928707cee4145b3b9d559bf131fad (127.10.30.65:44237)
I20260812 20:58:24.455240 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 18076
I20260812 20:58:24.455341 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:24.455552 10361 external_mini_cluster.cc:1428] Setting key ccea84f5c40d200bfeacf5aede11887c
I20260812 20:58:24.456777 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40371
--builtin_ntp_servers=127.10.30.84:41211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 20:58:24.556346 18294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:24.556607 18294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:24.556631 18294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:24.558068 18294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:24.558117 18294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:24.558147 18294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:24.559894 18294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:41211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:24.560153 18294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:24.560482 18294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:24.566416 18305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:24.566407 18303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:24.566404 18309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:24.566875 18294 server_base.cc:1034] running on GCE node
I20260812 20:58:24.567226 18294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:24.567657 18294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:24.568894 18294 hybrid_clock.cc:648] HybridClock initialized: now 1786568304568863 us; error 45 us; skew 500 ppm
I20260812 20:58:24.570603 18294 webserver.cc:460] Webserver started at http://127.10.30.66:41669/ using document root <none> and password file <none>
I20260812 20:58:24.571051 18294 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:24.571156 18294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:24.571352 18294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:24.572698 18294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "c2874e642e514f3a9751ee2764d11a8f"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "b82bbfae377aecd5eae2e8af1fb61107"
server_key_iv: "a8057661a719f934a6d6c9304eb8e4b0"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.573156 18294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "c2874e642e514f3a9751ee2764d11a8f"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "b82bbfae377aecd5eae2e8af1fb61107"
server_key_iv: "a8057661a719f934a6d6c9304eb8e4b0"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.574819 18294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 20:58:24.575928 18316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.576172 18294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:24.576303 18294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "c2874e642e514f3a9751ee2764d11a8f"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "b82bbfae377aecd5eae2e8af1fb61107"
server_key_iv: "a8057661a719f934a6d6c9304eb8e4b0"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.576403 18294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:24.580461 18294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:24.580806 18294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:24.580976 18294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:24.581230 18294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:24.581594 18294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:24.581655 18294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.581698 18294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:24.581723 18294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.588748 18294 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:32887
I20260812 20:58:24.588837 18514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:32887 every 8 connection(s)
I20260812 20:58:24.589250 18294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:24.593152 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.590166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:47973 (local address 127.10.30.126:40371)
0812 20:58:24.590240 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.590242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.590542 (+ 300us) server_negotiation.cc:407] Connection header received
0812 20:58:24.591182 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.591184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.591192 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.591263 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.592779 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.592780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.592781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.592785 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.592807 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.592811 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.592871 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.593056 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.593075 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 20:58:24.593379 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.590135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:40371 (local address 127.10.30.66:47973)
0812 20:58:24.590391 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.590439 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:24.591065 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:24.591391 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:24.591395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:24.591405 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:24.592598 (+ 1193us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:58:24.592599 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:24.592636 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:58:24.592672 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:24.592941 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:24.592948 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:24.592952 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:24.593040 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 20:58:24.593112 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":126,"threads_started":1}
I20260812 20:58:24.593988 18515 heartbeater.cc:347] Connected to a master server at 127.10.30.126:40371
I20260812 20:58:24.594097 18515 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:24.594241 18515 heartbeater.cc:511] Master 127.10.30.126:40371 requested a full tablet report, sending...
I20260812 20:58:24.594671 17973 ts_manager.cc:194] Registered new tserver with Master: c2874e642e514f3a9751ee2764d11a8f (127.10.30.66:32887)
I20260812 20:58:24.594807 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 18294
I20260812 20:58:24.594954 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:24.595229 10361 external_mini_cluster.cc:1428] Setting key 920195841d50c6ffc0c8c285359c3b2d
I20260812 20:58:24.596414 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40371
--builtin_ntp_servers=127.10.30.84:41211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 20:58:24.699137 18518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:24.699447 18518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:24.699476 18518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:24.700816 18518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:24.700868 18518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:24.700897 18518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:24.702411 18518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:41211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:24.702804 18518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:24.703274 18518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:24.709741 18533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:24.709718 18528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:24.709791 18529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:24.709924 18518 server_base.cc:1034] running on GCE node
I20260812 20:58:24.710208 18518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:24.710532 18518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:24.711740 18518 hybrid_clock.cc:648] HybridClock initialized: now 1786568304711691 us; error 73 us; skew 500 ppm
I20260812 20:58:24.713622 18518 webserver.cc:460] Webserver started at http://127.10.30.67:43537/ using document root <none> and password file <none>
I20260812 20:58:24.714010 18518 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:24.714119 18518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:24.714311 18518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:24.715782 18518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "e8abfb0f639d47e1976ae8607028dbc4"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "4a574b8240c7815cc1ef89a5c0998022"
server_key_iv: "338767549e833ef7e14b2063cd887e8b"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.716264 18518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "e8abfb0f639d47e1976ae8607028dbc4"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "4a574b8240c7815cc1ef89a5c0998022"
server_key_iv: "338767549e833ef7e14b2063cd887e8b"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.718047 18518 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:24.719156 18544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.719511 18518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260812 20:58:24.719671 18518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "e8abfb0f639d47e1976ae8607028dbc4"
format_stamp: "Formatted at 2026-08-12 20:58:24 on dist-test-slave-h3ft"
server_key: "4a574b8240c7815cc1ef89a5c0998022"
server_key_iv: "338767549e833ef7e14b2063cd887e8b"
server_key_version: "encryptionkey@0"
I20260812 20:58:24.719769 18518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:24.723762 18518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:24.724097 18518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:24.724256 18518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:24.724501 18518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:24.724879 18518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:24.724956 18518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.725000 18518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:24.725026 18518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:24.732656 18518 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:37487
I20260812 20:58:24.732746 18724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:37487 every 8 connection(s)
I20260812 20:58:24.733175 18518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:24.733907 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 18518
I20260812 20:58:24.734033 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:24.734299 10361 external_mini_cluster.cc:1428] Setting key 607d61a86aedab76ebc5a38feab3aa08
I20260812 20:58:24.738065 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.734383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:47293 (local address 127.10.30.126:40371)
0812 20:58:24.734468 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.734472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.734933 (+ 461us) server_negotiation.cc:407] Connection header received
0812 20:58:24.735830 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.735831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.735839 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.735885 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.737570 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.737572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.737572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.737578 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.737605 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.737611 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.737685 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.737968 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.737985 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 20:58:24.738286 18727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.734326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:40371 (local address 127.10.30.67:47293)
0812 20:58:24.734718 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.734762 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:24.735647 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:24.736003 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:24.736007 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:24.736020 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:24.737348 (+ 1328us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:58:24.737349 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:24.737390 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:58:24.737439 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:24.737777 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:24.737786 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:24.737790 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:24.737883 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 20:58:24.737988 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":120,"threads_started":1}
I20260812 20:58:24.738922 18725 heartbeater.cc:347] Connected to a master server at 127.10.30.126:40371
I20260812 20:58:24.739307 18725 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:24.739575 18725 heartbeater.cc:511] Master 127.10.30.126:40371 requested a full tablet report, sending...
I20260812 20:58:24.740090 17973 ts_manager.cc:194] Registered new tserver with Master: e8abfb0f639d47e1976ae8607028dbc4 (127.10.30.67:37487)
I20260812 20:58:24.747354 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:58:24.750738 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.749166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33890 (local address 127.10.30.126:40371)
0812 20:58:24.749252 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.749255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.749358 (+ 103us) server_negotiation.cc:407] Connection header received
0812 20:58:24.749439 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.749441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.749447 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.749503 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.750338 (+ 835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.750340 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.750340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.750344 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.750364 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.750368 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.750425 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.750480 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.750494 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:24.753247 17973 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:24.755355 17973 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:24.761246 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.759143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:44237 (local address 127.0.0.1:40442)
0812 20:58:24.759240 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.759251 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:24.759303 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:24.759857 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:24.759864 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:24.759873 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:24.760619 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:58:24.760619 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:24.760638 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:58:24.760663 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:24.760998 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:24.761008 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:24.761012 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:24.761105 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 20:58:24.761116 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":59,"threads_started":1}
I20260812 20:58:24.761232 18740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.758650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60830 (local address 127.10.30.66:32887)
0812 20:58:24.758903 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.758907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.759111 (+ 204us) server_negotiation.cc:407] Connection header received
0812 20:58:24.759249 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.759255 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.759270 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.759343 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.760808 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.760822 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.760823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.760831 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.760870 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.760912 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.760992 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.761107 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.761128 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":150,"threads_started":1}
I20260812 20:58:24.761730 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.759390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40442 (local address 127.10.30.65:44237)
0812 20:58:24.759670 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.759674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.759685 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:24.759720 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.759722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.759731 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.759833 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.760761 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.760776 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.760777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.760784 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.760836 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.760876 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.760952 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.761609 (+ 657us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.761631 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":144,"threads_started":1}
I20260812 20:58:24.761246 18742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.758452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:32887 (local address 127.0.0.1:60830)
0812 20:58:24.759030 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.759041 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:24.759152 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:24.759856 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:24.759863 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:24.759872 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:24.760665 (+ 793us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:58:24.760666 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:24.760674 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:58:24.760689 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:24.760998 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:24.761008 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:24.761012 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:24.761097 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 20:58:24.761115 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":513,"threads_started":1}
I20260812 20:58:24.761755 18739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.758524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38198 (local address 127.10.30.67:37487)
0812 20:58:24.758760 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.758766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.759134 (+ 368us) server_negotiation.cc:407] Connection header received
0812 20:58:24.759632 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.759646 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.759659 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.759729 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.761398 (+ 1669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.761409 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.761410 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.761415 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.761460 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.761493 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.761558 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.761641 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.761660 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":146,"threads_started":1}
I20260812 20:58:24.761996 18741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.758428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:37487 (local address 127.0.0.1:38198)
0812 20:58:24.758948 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.759025 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:24.759167 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:24.760353 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:24.760354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:24.760356 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:24.761016 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:58:24.761017 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:24.761023 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:58:24.761035 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:24.761548 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:24.761549 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:24.761549 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 20:58:24.761890 (+ 341us) client_negotiation.cc:240] Negotiation successful
0812 20:58:24.761908 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":407,"threads_started":1}
I20260812 20:58:24.762758 18407 tablet_service.cc:1467] Processing CreateTablet for tablet 7edc61e7919c46ba9a9374299dfc9b82 (DEFAULT_TABLE table=test-table [id=f506ee5909e14d1989cd994513d357cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:24.762841 18170 tablet_service.cc:1467] Processing CreateTablet for tablet 7edc61e7919c46ba9a9374299dfc9b82 (DEFAULT_TABLE table=test-table [id=f506ee5909e14d1989cd994513d357cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:24.763183 18627 tablet_service.cc:1467] Processing CreateTablet for tablet 7edc61e7919c46ba9a9374299dfc9b82 (DEFAULT_TABLE table=test-table [id=f506ee5909e14d1989cd994513d357cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:24.763366 18170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edc61e7919c46ba9a9374299dfc9b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:24.763365 18407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edc61e7919c46ba9a9374299dfc9b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:24.763579 18627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edc61e7919c46ba9a9374299dfc9b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:24.766693 18745 tablet_bootstrap.cc:492] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Bootstrap starting.
I20260812 20:58:24.767576 18746 tablet_bootstrap.cc:492] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad: Bootstrap starting.
I20260812 20:58:24.767620 18745 tablet_bootstrap.cc:654] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:24.767884 18748 tablet_bootstrap.cc:492] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: Bootstrap starting.
I20260812 20:58:24.768064 18745 log.cc:824] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:24.768540 18746 tablet_bootstrap.cc:654] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:24.768812 18748 tablet_bootstrap.cc:654] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:24.768985 18746 log.cc:824] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:24.769119 18745 tablet_bootstrap.cc:492] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: No bootstrap required, opened a new log
I20260812 20:58:24.769207 18745 ts_tablet_manager.cc:1397] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:58:24.769237 18748 log.cc:824] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:24.769869 18746 tablet_bootstrap.cc:492] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad: No bootstrap required, opened a new log
I20260812 20:58:24.769948 18746 ts_tablet_manager.cc:1397] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:24.771680 18748 tablet_bootstrap.cc:492] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: No bootstrap required, opened a new log
I20260812 20:58:24.771776 18748 ts_tablet_manager.cc:1397] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 20:58:24.772555 18745 raft_consensus.cc:348] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.772830 18745 raft_consensus.cc:374] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:24.772874 18745 raft_consensus.cc:729] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2874e642e514f3a9751ee2764d11a8f, State: Initialized, Role: FOLLOWER
I20260812 20:58:24.773061 18745 consensus_queue.cc:260] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.773129 18746 raft_consensus.cc:348] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.773350 18746 raft_consensus.cc:374] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:24.773428 18745 ts_tablet_manager.cc:1428] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260812 20:58:24.773427 18746 raft_consensus.cc:729] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afe928707cee4145b3b9d559bf131fad, State: Initialized, Role: FOLLOWER
I20260812 20:58:24.773494 18515 heartbeater.cc:503] Master 127.10.30.126:40371 was elected leader, sending a full tablet report...
I20260812 20:58:24.773563 18746 consensus_queue.cc:260] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.773895 18746 ts_tablet_manager.cc:1428] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 20:58:24.773924 18290 heartbeater.cc:503] Master 127.10.30.126:40371 was elected leader, sending a full tablet report...
I20260812 20:58:24.775080 18748 raft_consensus.cc:348] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.775292 18748 raft_consensus.cc:374] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:24.775401 18748 raft_consensus.cc:729] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8abfb0f639d47e1976ae8607028dbc4, State: Initialized, Role: FOLLOWER
I20260812 20:58:24.775552 18748 consensus_queue.cc:260] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.775862 18748 ts_tablet_manager.cc:1428] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 20:58:24.775943 18725 heartbeater.cc:503] Master 127.10.30.126:40371 was elected leader, sending a full tablet report...
W20260812 20:58:24.839974 18516 tablet.cc:2369] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:24.915977 18755 raft_consensus.cc:482] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:24.916276 18755 raft_consensus.cc:504] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.916818 18755 leader_election.cc:288] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8abfb0f639d47e1976ae8607028dbc4 (127.10.30.67:37487), afe928707cee4145b3b9d559bf131fad (127.10.30.65:44237)
I20260812 20:58:24.919041 18739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.917380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:44437 (local address 127.10.30.67:37487)
0812 20:58:24.917440 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.917443 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.917456 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:24.917500 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.917501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.917514 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.917628 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.918618 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.918621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.918621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.918627 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.918649 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.918654 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.918729 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.918908 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.918930 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 20:58:24.919037 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.917191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:37487 (local address 127.10.30.66:44437)
0812 20:58:24.917310 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.917326 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:24.917385 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:24.917668 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:24.917669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:24.917677 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:24.918441 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:58:24.918442 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:24.918453 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:58:24.918473 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:24.918789 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:24.918791 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:24.918792 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 20:58:24.918873 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 20:58:24.918916 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":24}
I20260812 20:58:24.919067 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.917380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:37441 (local address 127.10.30.65:44237)
0812 20:58:24.917440 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.917443 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.917597 (+ 154us) server_negotiation.cc:407] Connection header received
0812 20:58:24.917636 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.917637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.917645 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.917717 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.918615 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.918617 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.918617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.918623 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.918649 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.918654 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.918729 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.918912 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.918930 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 20:58:24.919070 18763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.917191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:44237 (local address 127.10.30.66:37441)
0812 20:58:24.917492 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.917508 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:24.917564 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:24.917742 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:24.917743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:24.917745 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:24.918441 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:58:24.918442 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:24.918454 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:58:24.918473 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:24.918789 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:24.918790 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:24.918792 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 20:58:24.918876 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 20:58:24.918906 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":29,"thread_start_us":176,"threads_started":1}
I20260812 20:58:24.919600 18209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edc61e7919c46ba9a9374299dfc9b82" candidate_uuid: "c2874e642e514f3a9751ee2764d11a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe928707cee4145b3b9d559bf131fad" is_pre_election: true
I20260812 20:58:24.919595 18662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edc61e7919c46ba9a9374299dfc9b82" candidate_uuid: "c2874e642e514f3a9751ee2764d11a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8abfb0f639d47e1976ae8607028dbc4" is_pre_election: true
I20260812 20:58:24.919818 18209 raft_consensus.cc:2454] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2874e642e514f3a9751ee2764d11a8f in term 0.
I20260812 20:58:24.919819 18662 raft_consensus.cc:2454] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2874e642e514f3a9751ee2764d11a8f in term 0.
I20260812 20:58:24.920187 18324 leader_election.cc:302] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afe928707cee4145b3b9d559bf131fad, c2874e642e514f3a9751ee2764d11a8f; no voters:
I20260812 20:58:24.920396 18755 raft_consensus.cc:2781] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:24.920492 18755 raft_consensus.cc:482] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:24.920536 18755 raft_consensus.cc:3037] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:24.921481 18755 raft_consensus.cc:504] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.921700 18755 leader_election.cc:288] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [CANDIDATE]: Term 1 election: Requested vote from peers e8abfb0f639d47e1976ae8607028dbc4 (127.10.30.67:37487), afe928707cee4145b3b9d559bf131fad (127.10.30.65:44237)
I20260812 20:58:24.921901 18209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edc61e7919c46ba9a9374299dfc9b82" candidate_uuid: "c2874e642e514f3a9751ee2764d11a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe928707cee4145b3b9d559bf131fad"
I20260812 20:58:24.921926 18662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edc61e7919c46ba9a9374299dfc9b82" candidate_uuid: "c2874e642e514f3a9751ee2764d11a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8abfb0f639d47e1976ae8607028dbc4"
I20260812 20:58:24.922037 18209 raft_consensus.cc:3037] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:24.922034 18662 raft_consensus.cc:3037] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:24.922986 18662 raft_consensus.cc:2454] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2874e642e514f3a9751ee2764d11a8f in term 1.
I20260812 20:58:24.923266 18321 leader_election.cc:302] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2874e642e514f3a9751ee2764d11a8f, e8abfb0f639d47e1976ae8607028dbc4; no voters:
I20260812 20:58:24.923377 18755 raft_consensus.cc:2781] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:24.923484 18209 raft_consensus.cc:2454] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2874e642e514f3a9751ee2764d11a8f in term 1.
I20260812 20:58:24.923631 18755 raft_consensus.cc:686] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 1 LEADER]: Becoming Leader. State: Replica: c2874e642e514f3a9751ee2764d11a8f, State: Running, Role: LEADER
I20260812 20:58:24.923779 18755 consensus_queue.cc:237] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } }
I20260812 20:58:24.925065 17973 catalog_manager.cc:5495] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c2874e642e514f3a9751ee2764d11a8f (127.10.30.66). New cstate: current_term: 1 leader_uuid: "c2874e642e514f3a9751ee2764d11a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2874e642e514f3a9751ee2764d11a8f" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 } health_report { overall_health: UNKNOWN } } }
W20260812 20:58:24.948331 18291 tablet.cc:2369] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:24.950752 18740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.949314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60844 (local address 127.10.30.66:32887)
0812 20:58:24.949435 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:24.949437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:24.949449 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:24.949507 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:24.949508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:24.949532 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:24.949644 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:24.950425 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:24.950427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:24.950428 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:24.950433 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:24.950482 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:24.950488 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:24.950565 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:24.950634 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 20:58:24.950651 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 20:58:24.953557 18662 raft_consensus.cc:1261] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 1 FOLLOWER]: Refusing update from remote peer c2874e642e514f3a9751ee2764d11a8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:24.953557 18209 raft_consensus.cc:1261] T 7edc61e7919c46ba9a9374299dfc9b82 P afe928707cee4145b3b9d559bf131fad [term 1 FOLLOWER]: Refusing update from remote peer c2874e642e514f3a9751ee2764d11a8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:24.954044 18755 consensus_queue.cc:1035] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8abfb0f639d47e1976ae8607028dbc4" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:24.954257 18764 consensus_queue.cc:1035] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe928707cee4145b3b9d559bf131fad" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:24.957206 18775 mvcc.cc:205] Tried to move back new op lower bound from 7317783777085595648 to 7317783776968540160. Current Snapshot: MvccSnapshot[applied={T|T < 7317783777085595648}]
I20260812 20:58:24.958599 18777 mvcc.cc:205] Tried to move back new op lower bound from 7317783777085595648 to 7317783776968540160. Current Snapshot: MvccSnapshot[applied={T|T < 7317783777085595648 or (T in {7317783777085595648})}]
I20260812 20:58:24.960599 17971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:24.960752 17971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:24.961892 17971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 66bf38d832f840fa9226359653832605: Sending DeleteTablet for 3 replicas of tablet 7edc61e7919c46ba9a9374299dfc9b82
I20260812 20:58:24.962419 18170 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edc61e7919c46ba9a9374299dfc9b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:24 UTC) from {username='slave'} at 127.0.0.1:40442
I20260812 20:58:24.962457 18627 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edc61e7919c46ba9a9374299dfc9b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:24 UTC) from {username='slave'} at 127.0.0.1:38198
I20260812 20:58:24.962826 18407 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edc61e7919c46ba9a9374299dfc9b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:24 UTC) from {username='slave'} at 127.0.0.1:60830
I20260812 20:58:24.962944 18785 tablet_replica.cc:330] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: stopping tablet replica
I20260812 20:58:24.963104 18785 raft_consensus.cc:2229] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:24.963152 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 18076
I20260812 20:58:24.963234 18785 raft_consensus.cc:2258] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:24.963330 18788 tablet_replica.cc:330] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: stopping tablet replica
I20260812 20:58:24.963434 18788 raft_consensus.cc:2229] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:24.963544 18788 raft_consensus.cc:2258] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:24.967772 18788 ts_tablet_manager.cc:1905] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:24.970052 18788 ts_tablet_manager.cc:1918] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:24.970149 18788 log.cc:1196] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/7edc61e7919c46ba9a9374299dfc9b82
I20260812 20:58:24.970470 18788 ts_tablet_manager.cc:1939] T 7edc61e7919c46ba9a9374299dfc9b82 P c2874e642e514f3a9751ee2764d11a8f: Deleting consensus metadata
I20260812 20:58:24.971139 17954 catalog_manager.cc:4841] TS c2874e642e514f3a9751ee2764d11a8f (127.10.30.66:32887): tablet 7edc61e7919c46ba9a9374299dfc9b82 (table test-table [id=f506ee5909e14d1989cd994513d357cc]) successfully deleted
I20260812 20:58:24.972492 18785 ts_tablet_manager.cc:1905] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:24.975126 18785 ts_tablet_manager.cc:1918] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:24.975396 18785 log.cc:1196] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/7edc61e7919c46ba9a9374299dfc9b82
I20260812 20:58:24.975852 18785 ts_tablet_manager.cc:1939] T 7edc61e7919c46ba9a9374299dfc9b82 P e8abfb0f639d47e1976ae8607028dbc4: Deleting consensus metadata
I20260812 20:58:24.976541 17951 catalog_manager.cc:4841] TS e8abfb0f639d47e1976ae8607028dbc4 (127.10.30.67:37487): tablet 7edc61e7919c46ba9a9374299dfc9b82 (table test-table [id=f506ee5909e14d1989cd994513d357cc]) successfully deleted
W20260812 20:58:24.983618 17954 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:44237 (error 108)
I20260812 20:58:24.984380 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:24.984198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:44237 (local address 127.0.0.1:40444)
0812 20:58:24.984270 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:24.984331 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:44237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 20:58:24.984552 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 18294
W20260812 20:58:24.996691 17954 catalog_manager.cc:4584] TS afe928707cee4145b3b9d559bf131fad (127.10.30.65:44237): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7edc61e7919c46ba9a9374299dfc9b82: Network error: Client connection negotiation failed: client connection to 127.10.30.65:44237: connect: Connection refused (error 111)
I20260812 20:58:25.010187 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 18518
I20260812 20:58:25.029906 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 17928
2026-08-12T20:58:25Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (958 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 20:58:25.061750 10361 mini_oidc.cc:152] Starting JWKS server
I20260812 20:58:25.063345 10361 webserver.cc:460] Webserver started at https://127.0.0.1:38389/ using document root <none> and password file <none>
I20260812 20:58:25.063481 10361 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 20:58:25.063736 10361 webserver.cc:460] Webserver started at http://127.0.0.1:36605/ using document root <none> and password file <none>
2026-08-12T20:58:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:25Z Disabled control of system clock
I20260812 20:58:25.077023 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:37789
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:36119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:37789
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38389/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/testchainca.cert with env {}
W20260812 20:58:25.179399 18797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:25.179863 18797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:25.179905 18797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:25.181210 18797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:25.181262 18797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:25.181273 18797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:25.181286 18797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:25.181298 18797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 20:58:25.181311 18797 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 20:58:25.181322 18797 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38389/jwks.json
I20260812 20:58:25.183562 18797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:36119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:37789
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:37789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38389/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:25.183862 18797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:25.184091 18797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:25.190032 18811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:25.190236 18797 server_base.cc:1034] running on GCE node
W20260812 20:58:25.190042 18812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:25.190064 18815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:25.190681 18797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:25.191121 18797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:25.192293 18797 hybrid_clock.cc:648] HybridClock initialized: now 1786568305192265 us; error 49 us; skew 500 ppm
I20260812 20:58:25.194103 18797 webserver.cc:460] Webserver started at http://127.10.30.126:39079/ using document root <none> and password file <none>
I20260812 20:58:25.194399 18797 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:25.194449 18797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:25.194629 18797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:25.195950 18797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "282eed2064364092ab90606ae9fb3dde"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "e8788c282c196ce5ab5480e94ebe73fa"
server_key_iv: "dcb8c1646cb6de702434fd78d196aa70"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.196391 18797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "282eed2064364092ab90606ae9fb3dde"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "e8788c282c196ce5ab5480e94ebe73fa"
server_key_iv: "dcb8c1646cb6de702434fd78d196aa70"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.197897 18797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 20:58:25.198804 18824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:25.199112 18797 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:25.199239 18797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "282eed2064364092ab90606ae9fb3dde"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "e8788c282c196ce5ab5480e94ebe73fa"
server_key_iv: "dcb8c1646cb6de702434fd78d196aa70"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.199326 18797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:25.235960 18797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:25.236492 18797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:25.236701 18797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:25.242028 18797 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:37789
I20260812 20:58:25.242069 18899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:37789 every 8 connection(s)
I20260812 20:58:25.242529 18797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:25.243871 18902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:25.244763 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 18797
I20260812 20:58:25.244902 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:25.245114 10361 external_mini_cluster.cc:1428] Setting key c252a602063346cf817eaac3649459d0
I20260812 20:58:25.247697 18902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde: Bootstrap starting.
I20260812 20:58:25.248605 18902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:25.248988 18902 log.cc:824] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:25.249904 18902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde: No bootstrap required, opened a new log
I20260812 20:58:25.251988 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:25.245774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39778 (local address 127.10.30.126:37789)
0812 20:58:25.246032 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:25.246041 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:25.246071 (+ 30us) server_negotiation.cc:407] Connection header received
0812 20:58:25.246552 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:25.246559 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:25.246643 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:25.246781 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:25.247190 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.248486 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.249637 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.250170 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.250277 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.251145 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:25.251149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:25.251149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:25.251353 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:25.251391 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:25.251404 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:25.251468 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:25.251618 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 20:58:25.251694 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":85,"threads_started":1}
I20260812 20:58:25.252907 18902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282eed2064364092ab90606ae9fb3dde" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37789 } }
I20260812 20:58:25.253101 18902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:25.253154 18902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 282eed2064364092ab90606ae9fb3dde, State: Initialized, Role: FOLLOWER
I20260812 20:58:25.253156 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 20:58:25.253294 18902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282eed2064364092ab90606ae9fb3dde" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37789 } }
I20260812 20:58:25.253368 18902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:25.253392 18902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:25.253466 18902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:25.254192 18902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282eed2064364092ab90606ae9fb3dde" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37789 } }
I20260812 20:58:25.254331 18902 leader_election.cc:302] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 282eed2064364092ab90606ae9fb3dde; no voters:
I20260812 20:58:25.254570 18902 leader_election.cc:288] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:25.254642 18909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:25.254807 18909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [term 1 LEADER]: Becoming Leader. State: Replica: 282eed2064364092ab90606ae9fb3dde, State: Running, Role: LEADER
I20260812 20:58:25.254925 18902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:25.254952 18909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282eed2064364092ab90606ae9fb3dde" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37789 } }
I20260812 20:58:25.255388 18910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "282eed2064364092ab90606ae9fb3dde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282eed2064364092ab90606ae9fb3dde" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37789 } } }
I20260812 20:58:25.255391 18911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 282eed2064364092ab90606ae9fb3dde. Latest consensus state: current_term: 1 leader_uuid: "282eed2064364092ab90606ae9fb3dde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "282eed2064364092ab90606ae9fb3dde" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37789 } } }
I20260812 20:58:25.255550 18911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:25.255772 18910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:25.255868 18922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:25.256498 18922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:25.258448 18922 catalog_manager.cc:1347] Generated new cluster ID: 07251d1d411f4e929612ce1ca25ab085
I20260812 20:58:25.258507 18922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:25.265643 18922 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:25.266506 18922 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:25.269286 18922 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 282eed2064364092ab90606ae9fb3dde: Generated new TSK 0
I20260812 20:58:25.269521 18922 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 20:58:25.305768 18955 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 20:58:25.306046 18955 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 20:58:25.306250 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:25.281830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39794 (local address 127.10.30.126:37789)
0812 20:58:25.281893 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:25.281901 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:25.282033 (+ 132us) server_negotiation.cc:407] Connection header received
0812 20:58:25.282159 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:25.282160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:25.282174 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:25.282244 (+ 70us) server_negotiation.cc:226] Negotiated authn=JWT
0812 20:58:25.282439 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.283162 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.284376 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.284608 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.284681 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.284958 (+ 277us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 20:58:25.305699 (+ 20741us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 20:58:25.306057 (+ 358us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39794: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 20:58:25.306357 18907 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39794: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 20:58:25.306648 18953 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:25.281693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:37789 (local address 127.0.0.1:39794)
0812 20:58:25.281936 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:25.281950 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:25.282045 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:25.282273 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:25.282274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:25.282276 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 20:58:25.282367 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:25.282369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.283246 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.283247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:25.284255 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:25.284258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.284705 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.284706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:25.284778 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.284808 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 20:58:25.305904 (+ 21096us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 20:58:25.306097 (+ 193us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.30.126:37789: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":117,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.30.126:37789: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 20:58:25.307350 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 18797
2026-08-12T20:58:25Z chronyd exiting
I20260812 20:58:25.362039 10361 test_util.cc:175] -----------------------------------------------
I20260812 20:58:25.362159 10361 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786568275908695-10361-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (302 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 20:58:25.363288 10361 mini_oidc.cc:152] Starting JWKS server
I20260812 20:58:25.364055 10361 webserver.cc:460] Webserver started at https://127.0.0.1:38119/ using document root <none> and password file <none>
I20260812 20:58:25.364100 10361 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 20:58:25.364264 10361 webserver.cc:460] Webserver started at http://127.0.0.1:43865/ using document root <none> and password file <none>
2026-08-12T20:58:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:25Z Disabled control of system clock
I20260812 20:58:25.375561 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43693
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:34617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:43693
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38119/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/testchainca.cert with env {}
W20260812 20:58:25.471354 18966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:25.471678 18966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:25.471719 18966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:25.473097 18966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:25.473178 18966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:25.473201 18966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:25.473222 18966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:25.473254 18966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 20:58:25.473277 18966 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 20:58:25.473304 18966 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38119/jwks.json
I20260812 20:58:25.475116 18966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:34617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:43693
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38119/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:25.475485 18966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:25.475765 18966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:25.481799 18983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:25.481863 18986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:25.482147 18966 server_base.cc:1034] running on GCE node
W20260812 20:58:25.481882 18981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:25.482594 18966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:25.482981 18966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:25.484205 18966 hybrid_clock.cc:648] HybridClock initialized: now 1786568305484169 us; error 65 us; skew 500 ppm
I20260812 20:58:25.485852 18966 webserver.cc:460] Webserver started at http://127.10.30.126:40053/ using document root <none> and password file <none>
I20260812 20:58:25.486233 18966 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:25.486312 18966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:25.486483 18966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:25.487864 18966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "c165c0a42ada45289df4728b004b83c9"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "36d48d8b665eeaf1740600b33670d7c7"
server_key_iv: "173ffbdd5e6c942feacc930ba725dba5"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.488306 18966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "c165c0a42ada45289df4728b004b83c9"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "36d48d8b665eeaf1740600b33670d7c7"
server_key_iv: "173ffbdd5e6c942feacc930ba725dba5"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.489871 18966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 20:58:25.490769 18993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:25.490985 18966 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:25.491155 18966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "c165c0a42ada45289df4728b004b83c9"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "36d48d8b665eeaf1740600b33670d7c7"
server_key_iv: "173ffbdd5e6c942feacc930ba725dba5"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.491243 18966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:25.508237 18966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:25.508728 18966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:25.508920 18966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:25.514442 18966 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:43693
I20260812 20:58:25.514494 19085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:43693 every 8 connection(s)
I20260812 20:58:25.514945 18966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:25.516330 19086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:25.519375 19086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9: Bootstrap starting.
I20260812 20:58:25.520152 19086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:25.520502 19086 log.cc:824] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:25.521543 19086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9: No bootstrap required, opened a new log
I20260812 20:58:25.522349 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 18966
I20260812 20:58:25.522490 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:25.522751 10361 external_mini_cluster.cc:1428] Setting key 1cfea7a14c74c0db5e2c2a991c5afded
I20260812 20:58:25.524588 19086 raft_consensus.cc:348] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c165c0a42ada45289df4728b004b83c9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43693 } }
I20260812 20:58:25.524811 19086 raft_consensus.cc:374] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:25.524887 19086 raft_consensus.cc:729] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c165c0a42ada45289df4728b004b83c9, State: Initialized, Role: FOLLOWER
I20260812 20:58:25.525058 19086 consensus_queue.cc:260] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c165c0a42ada45289df4728b004b83c9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43693 } }
I20260812 20:58:25.525162 19086 raft_consensus.cc:388] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:25.525192 19086 raft_consensus.cc:482] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:25.525281 19086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:25.526065 19086 raft_consensus.cc:504] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c165c0a42ada45289df4728b004b83c9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43693 } }
I20260812 20:58:25.526218 19086 leader_election.cc:302] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c165c0a42ada45289df4728b004b83c9; no voters:
I20260812 20:58:25.526446 19086 leader_election.cc:288] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:25.526484 19092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:25.526648 19092 raft_consensus.cc:686] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [term 1 LEADER]: Becoming Leader. State: Replica: c165c0a42ada45289df4728b004b83c9, State: Running, Role: LEADER
I20260812 20:58:25.526746 19092 consensus_queue.cc:237] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c165c0a42ada45289df4728b004b83c9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43693 } }
I20260812 20:58:25.526849 19086 sys_catalog.cc:564] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:25.527171 19092 sys_catalog.cc:455] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c165c0a42ada45289df4728b004b83c9. Latest consensus state: current_term: 1 leader_uuid: "c165c0a42ada45289df4728b004b83c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c165c0a42ada45289df4728b004b83c9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43693 } } }
I20260812 20:58:25.527277 19092 sys_catalog.cc:458] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:25.527182 19094 sys_catalog.cc:455] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c165c0a42ada45289df4728b004b83c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c165c0a42ada45289df4728b004b83c9" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43693 } } }
I20260812 20:58:25.527486 19094 sys_catalog.cc:458] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:25.528273 19097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:25.529014 19097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:25.530994 19097 catalog_manager.cc:1347] Generated new cluster ID: ebed34e28d3548b18ac65d445692c4e6
I20260812 20:58:25.531083 19097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:25.535558 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:25.523492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56430 (local address 127.10.30.126:43693)
0812 20:58:25.523793 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:25.523802 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:25.523839 (+ 37us) server_negotiation.cc:407] Connection header received
0812 20:58:25.524572 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:25.524582 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:25.524670 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:25.524979 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:25.525318 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.527114 (+ 1796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.528407 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.529168 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.529839 (+ 671us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.530339 (+ 500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:25.530343 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:25.530344 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:25.530670 (+ 326us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:25.530720 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:25.530738 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:25.530819 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:25.535154 (+ 4335us) server_negotiation.cc:299] Negotiation successful
0812 20:58:25.535286 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":120,"threads_started":1}
I20260812 20:58:25.536924 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 20:58:25.542270 19097 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:25.543077 19097 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:25.550812 19097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c165c0a42ada45289df4728b004b83c9: Generated new TSK 0
I20260812 20:58:25.551105 19097 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 20:58:25.583235 19133 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 20:58:25.583384 19133 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 20:58:25.583953 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:25.561071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56442 (local address 127.10.30.126:43693)
0812 20:58:25.561162 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:25.561165 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:25.561306 (+ 141us) server_negotiation.cc:407] Connection header received
0812 20:58:25.561410 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:25.561411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:25.561432 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:25.561527 (+ 95us) server_negotiation.cc:226] Negotiated authn=JWT
0812 20:58:25.561703 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.562281 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.563246 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.563465 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.563552 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.563773 (+ 221us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 20:58:25.583571 (+ 19798us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 20:58:25.583836 (+ 265us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56442: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 20:58:25.584044 19132 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:25.560992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43693 (local address 127.0.0.1:56442)
0812 20:58:25.561217 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:25.561229 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:25.561328 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:25.561525 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:25.561526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:25.561529 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0812 20:58:25.561606 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:25.561609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.562381 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.562382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:25.563141 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:25.563144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.563560 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.563562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:25.563626 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.563633 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 20:58:25.583757 (+ 20124us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 20:58:25.583917 (+ 160us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.30.126:43693: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":122,"threads_started":1}
W20260812 20:58:25.584051 19091 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56442: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260812 20:58:25.584702 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 18966
2026-08-12T20:58:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (281 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 20:58:25.644680 10361 mini_oidc.cc:152] Starting JWKS server
I20260812 20:58:25.645478 10361 webserver.cc:460] Webserver started at https://127.0.0.1:37611/ using document root <none> and password file <none>
I20260812 20:58:25.645525 10361 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 20:58:25.645691 10361 webserver.cc:460] Webserver started at http://127.0.0.1:37193/ using document root <none> and password file <none>
2026-08-12T20:58:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:25Z Disabled control of system clock
I20260812 20:58:25.657173 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35771
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:35771
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37611/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 20:58:25.755853 19141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:25.756206 19141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:25.756250 19141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:25.757620 19141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:25.757714 19141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:25.757736 19141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:25.757758 19141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:25.757787 19141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 20:58:25.757819 19141 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 20:58:25.757839 19141 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37611/jwks.json
I20260812 20:58:25.759510 19141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:35771
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37611/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:25.759886 19141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:25.760298 19141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:25.766237 19150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:25.766274 19155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:25.766273 19147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:25.766486 19141 server_base.cc:1034] running on GCE node
I20260812 20:58:25.766795 19141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:25.767268 19141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:25.768455 19141 hybrid_clock.cc:648] HybridClock initialized: now 1786568305768426 us; error 46 us; skew 500 ppm
I20260812 20:58:25.770125 19141 webserver.cc:460] Webserver started at http://127.10.30.126:46143/ using document root <none> and password file <none>
I20260812 20:58:25.770475 19141 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:25.770531 19141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:25.770721 19141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:25.772158 19141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "a28624bb2ce446328f1a4b3402637cbe"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "6b9c1b973ec0e205b8103c7f4b4f5bf2"
server_key_iv: "86b7c53f09f53f344b3126de0fe58cd6"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.772622 19141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "a28624bb2ce446328f1a4b3402637cbe"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "6b9c1b973ec0e205b8103c7f4b4f5bf2"
server_key_iv: "86b7c53f09f53f344b3126de0fe58cd6"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.774397 19141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 20:58:25.775506 19164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:25.775777 19141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:25.775887 19141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "a28624bb2ce446328f1a4b3402637cbe"
format_stamp: "Formatted at 2026-08-12 20:58:25 on dist-test-slave-h3ft"
server_key: "6b9c1b973ec0e205b8103c7f4b4f5bf2"
server_key_iv: "86b7c53f09f53f344b3126de0fe58cd6"
server_key_version: "encryptionkey@0"
I20260812 20:58:25.776013 19141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:25.797196 19141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:25.797690 19141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:25.797889 19141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:25.803474 19141 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:35771
I20260812 20:58:25.803505 19252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:35771 every 8 connection(s)
I20260812 20:58:25.804005 19141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:25.804932 19255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:25.808626 19255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe: Bootstrap starting.
I20260812 20:58:25.809428 19255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:25.809795 19255 log.cc:824] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:25.810680 19255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe: No bootstrap required, opened a new log
I20260812 20:58:25.812695 19255 raft_consensus.cc:348] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28624bb2ce446328f1a4b3402637cbe" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35771 } }
I20260812 20:58:25.812875 19255 raft_consensus.cc:374] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:25.812901 19255 raft_consensus.cc:729] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28624bb2ce446328f1a4b3402637cbe, State: Initialized, Role: FOLLOWER
I20260812 20:58:25.813108 19255 consensus_queue.cc:260] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28624bb2ce446328f1a4b3402637cbe" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35771 } }
I20260812 20:58:25.813187 19255 raft_consensus.cc:388] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:25.813211 19255 raft_consensus.cc:482] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:25.813289 19255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:25.813788 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 19141
I20260812 20:58:25.813987 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:25.814131 19255 raft_consensus.cc:504] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28624bb2ce446328f1a4b3402637cbe" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35771 } }
I20260812 20:58:25.814261 10361 external_mini_cluster.cc:1428] Setting key 41b631bd14eac82f923a1655616571d8
I20260812 20:58:25.814271 19255 leader_election.cc:302] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a28624bb2ce446328f1a4b3402637cbe; no voters:
I20260812 20:58:25.814618 19255 leader_election.cc:288] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:25.814690 19259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:25.815037 19259 raft_consensus.cc:686] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [term 1 LEADER]: Becoming Leader. State: Replica: a28624bb2ce446328f1a4b3402637cbe, State: Running, Role: LEADER
I20260812 20:58:25.815213 19259 consensus_queue.cc:237] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28624bb2ce446328f1a4b3402637cbe" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35771 } }
I20260812 20:58:25.815274 19255 sys_catalog.cc:564] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:25.816787 19260 sys_catalog.cc:455] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a28624bb2ce446328f1a4b3402637cbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28624bb2ce446328f1a4b3402637cbe" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35771 } } }
I20260812 20:58:25.816880 19260 sys_catalog.cc:458] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:25.817121 19262 sys_catalog.cc:455] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader a28624bb2ce446328f1a4b3402637cbe. Latest consensus state: current_term: 1 leader_uuid: "a28624bb2ce446328f1a4b3402637cbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28624bb2ce446328f1a4b3402637cbe" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35771 } } }
I20260812 20:58:25.817317 19262 sys_catalog.cc:458] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe [sys.catalog]: This master's current role is: LEADER
W20260812 20:58:25.817849 19284 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 20:58:25.817922 19284 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 20:58:25.817981 19287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:25.818202 19287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:25.822355 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:25.814961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58292 (local address 127.10.30.126:35771)
0812 20:58:25.815412 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:25.815424 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:25.815467 (+ 43us) server_negotiation.cc:407] Connection header received
0812 20:58:25.815587 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:25.815594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:25.815657 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:25.815788 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:25.816236 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.818713 (+ 2477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.819933 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.820384 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.820491 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.821341 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:25.821345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:25.821346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:25.821561 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:25.821601 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:25.821614 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:25.821722 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:25.821961 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 20:58:25.822060 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":125,"threads_started":1}
I20260812 20:58:25.823539 19287 catalog_manager.cc:1347] Generated new cluster ID: cae79adcdd94437486f8af65ac9c1455
I20260812 20:58:25.823602 19287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:25.823927 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 20:58:25.839599 19287 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:25.840394 19287 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:25.844679 19287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a28624bb2ce446328f1a4b3402637cbe: Generated new TSK 0
I20260812 20:58:25.844949 19287 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 20:58:25.863102 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:25.858302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58300 (local address 127.10.30.126:35771)
0812 20:58:25.858378 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:25.858381 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:25.858521 (+ 140us) server_negotiation.cc:407] Connection header received
0812 20:58:25.858596 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:25.858598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:25.858635 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:25.858741 (+ 106us) server_negotiation.cc:226] Negotiated authn=JWT
0812 20:58:25.858994 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.859908 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.860826 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.861179 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.861258 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.861623 (+ 365us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 20:58:25.862807 (+ 1184us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37611/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 20:58:25.862973 (+ 166us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58300: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37611/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 20:58:25.863533 19263 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58300: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37611/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 20:58:25.864051 19298 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:25.858185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:35771 (local address 127.0.0.1:58300)
0812 20:58:25.858434 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:25.858447 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:25.858521 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:25.858807 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:25.858808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:25.858811 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0812 20:58:25.858888 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:25.858891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.860030 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.860031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:25.860728 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:25.860730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:25.861362 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:25.861363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:25.861461 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:25.861470 (+ 9us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 20:58:25.863789 (+ 2319us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37611/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 20:58:25.863937 (+ 148us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.30.126:35771: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37611/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":137,"threads_started":1}
I20260812 20:58:25.865041 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 19141
E20260812 20:58:25.903542 19300 webserver.cc:533] Webserver: sslize failed:
E20260812 20:58:25.903688 19300 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T20:58:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (289 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T20:58:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:25Z Disabled control of system clock
I20260812 20:58:25.946440 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:39357
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:44031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:39357
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/testchainca.cert with env {}
W20260812 20:58:26.046836 19308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:26.047159 19308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:26.047187 19308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:26.048633 19308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:26.048692 19308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:26.048707 19308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:26.048719 19308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:26.048732 19308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 20:58:26.048745 19308 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 20:58:26.048756 19308 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 20:58:26.050613 19308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:39357
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:39357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:26.051363 19308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:26.051712 19308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:26.057811 19320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:26.057796 19317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:26.057797 19315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:26.058166 19308 server_base.cc:1034] running on GCE node
I20260812 20:58:26.058471 19308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:26.058866 19308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:26.060101 19308 hybrid_clock.cc:648] HybridClock initialized: now 1786568306060072 us; error 50 us; skew 500 ppm
I20260812 20:58:26.061914 19308 webserver.cc:460] Webserver started at http://127.10.30.126:45865/ using document root <none> and password file <none>
I20260812 20:58:26.062235 19308 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:26.062322 19308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:26.062505 19308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:26.064064 19308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "2ef002abc1074aaf841a6572c064a4c3"
format_stamp: "Formatted at 2026-08-12 20:58:26 on dist-test-slave-h3ft"
server_key: "41186ec6bdc6b95fa0e987038980c265"
server_key_iv: "1afaa8e86138b06909d8105829301523"
server_key_version: "encryptionkey@0"
I20260812 20:58:26.064529 19308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "2ef002abc1074aaf841a6572c064a4c3"
format_stamp: "Formatted at 2026-08-12 20:58:26 on dist-test-slave-h3ft"
server_key: "41186ec6bdc6b95fa0e987038980c265"
server_key_iv: "1afaa8e86138b06909d8105829301523"
server_key_version: "encryptionkey@0"
I20260812 20:58:26.066423 19308 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 20:58:26.067576 19333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:26.067826 19308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:26.068029 19308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "2ef002abc1074aaf841a6572c064a4c3"
format_stamp: "Formatted at 2026-08-12 20:58:26 on dist-test-slave-h3ft"
server_key: "41186ec6bdc6b95fa0e987038980c265"
server_key_iv: "1afaa8e86138b06909d8105829301523"
server_key_version: "encryptionkey@0"
I20260812 20:58:26.068138 19308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:26.088303 19308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:26.088789 19308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:26.089006 19308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:26.094470 19308 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:39357
I20260812 20:58:26.094544 19420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:39357 every 8 connection(s)
I20260812 20:58:26.095042 19308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:26.096450 19422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:26.099927 19422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3: Bootstrap starting.
I20260812 20:58:26.100829 19422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:26.101253 19422 log.cc:824] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:26.102321 19422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3: No bootstrap required, opened a new log
I20260812 20:58:26.103919 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 19308
I20260812 20:58:26.104137 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:26.104383 10361 external_mini_cluster.cc:1428] Setting key 6b3244ec97ec93758ac3ad29a3aae84f
I20260812 20:58:26.104815 19422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef002abc1074aaf841a6572c064a4c3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39357 } }
I20260812 20:58:26.105082 19422 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:26.105124 19422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef002abc1074aaf841a6572c064a4c3, State: Initialized, Role: FOLLOWER
I20260812 20:58:26.105340 19422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef002abc1074aaf841a6572c064a4c3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39357 } }
I20260812 20:58:26.105461 19422 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:26.105518 19422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:26.105572 19422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:26.106545 19422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef002abc1074aaf841a6572c064a4c3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39357 } }
I20260812 20:58:26.106660 19422 leader_election.cc:302] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ef002abc1074aaf841a6572c064a4c3; no voters:
I20260812 20:58:26.106918 19422 leader_election.cc:288] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:26.106950 19430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:26.107111 19430 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2ef002abc1074aaf841a6572c064a4c3, State: Running, Role: LEADER
I20260812 20:58:26.107213 19430 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef002abc1074aaf841a6572c064a4c3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39357 } }
I20260812 20:58:26.107306 19422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:26.107674 19434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ef002abc1074aaf841a6572c064a4c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef002abc1074aaf841a6572c064a4c3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39357 } } }
I20260812 20:58:26.107777 19434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:26.107658 19430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ef002abc1074aaf841a6572c064a4c3. Latest consensus state: current_term: 1 leader_uuid: "2ef002abc1074aaf841a6572c064a4c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef002abc1074aaf841a6572c064a4c3" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39357 } } }
I20260812 20:58:26.108002 19430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:26.108170 19441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:26.108958 19441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:26.111028 19441 catalog_manager.cc:1347] Generated new cluster ID: bcd72a3e65bd4d1f8a184f24c29de9d3
I20260812 20:58:26.111093 19441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:26.112668 19428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:26.105245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47428 (local address 127.10.30.126:39357)
0812 20:58:26.105561 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:26.105574 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:26.105642 (+ 68us) server_negotiation.cc:407] Connection header received
0812 20:58:26.105784 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:26.105791 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:26.105861 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:26.106012 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:26.106333 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:26.108359 (+ 2026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:26.109728 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:26.110368 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:26.110525 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:26.111667 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:26.111671 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:26.111671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:58:26.111944 (+ 273us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:26.111994 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:58:26.112010 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:26.112261 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:26.112297 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 20:58:26.112391 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":164,"threads_started":1}
I20260812 20:58:26.114367 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 20:58:26.118916 19441 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:26.119642 19441 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:26.130381 19441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ef002abc1074aaf841a6572c064a4c3: Generated new TSK 0
I20260812 20:58:26.130730 19441 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 20:58:26.198431 19428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:26.140500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47440 (local address 127.10.30.126:39357)
0812 20:58:26.140598 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:26.140600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:26.140665 (+ 65us) server_negotiation.cc:407] Connection header received
0812 20:58:26.140819 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:26.140820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:26.140837 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:26.140937 (+ 100us) server_negotiation.cc:226] Negotiated authn=JWT
0812 20:58:26.141147 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:26.142016 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:26.142965 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:26.143355 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:26.143434 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:26.143680 (+ 246us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 20:58:26.198040 (+ 54360us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 20:58:26.198322 (+ 282us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47440: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 20:58:26.198556 19428 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47440: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 20:58:26.198637 19472 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:26.140344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39357 (local address 127.0.0.1:47440)
0812 20:58:26.140574 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:26.140587 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:26.140704 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:26.140972 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:26.140974 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:26.140977 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0812 20:58:26.141055 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:26.141058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:26.142158 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:26.142160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:26.142866 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:26.142868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:26.143471 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:26.143472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:26.143531 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:26.143538 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 20:58:26.198289 (+ 54751us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 20:58:26.198478 (+ 189us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.30.126:39357: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":117,"threads_started":1}
I20260812 20:58:26.199095 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 19308
2026-08-12T20:58:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (297 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (109 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (113 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:26 dist-test-slave-h3ft krb5kdc[19490](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:26 dist-test-slave-h3ft krb5kdc[19490](info): set up 2 sockets
Aug 12 20:58:26 dist-test-slave-h3ft krb5kdc[19490](info): commencing operation
krb5kdc: starting...
W20260812 20:58:27.842775 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.387s user 0.002s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:27 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:28.004235 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:39429
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:39429
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:28.104821 19514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:28.105209 19514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:28.105257 19514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:28.106827 19514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:28.106941 19514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:28.106967 19514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:28.106990 19514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:28.107009 19514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:28.109071 19514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:39429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:39429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:28.109508 19514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:28.109827 19514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:28.116364 19526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:28.116447 19522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:28.116439 19519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:28.116680 19514 server_base.cc:1034] running on GCE node
I20260812 20:58:28.117081 19514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:28.117527 19514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:28.118702 19514 hybrid_clock.cc:648] HybridClock initialized: now 1786568308118681 us; error 49 us; skew 500 ppm
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.122212 19514 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:28.122805 19514 webserver.cc:460] Webserver started at http://127.10.30.126:38907/ using document root <none> and password file <none>
I20260812 20:58:28.123199 19514 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:28.123287 19514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:28.123478 19514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:28.124939 19514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "242ad90d42ac491f87880d212c38242d"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "cdfa02cb6c5b9ef2020eac5a8a057cb9"
server_key_iv: "444a938cdfe565b10c18fe1f3dc06059"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.125450 19514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "242ad90d42ac491f87880d212c38242d"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "cdfa02cb6c5b9ef2020eac5a8a057cb9"
server_key_iv: "444a938cdfe565b10c18fe1f3dc06059"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.127367 19514 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 20:58:28.128417 19538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.128650 19514 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:28.128783 19514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "242ad90d42ac491f87880d212c38242d"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "cdfa02cb6c5b9ef2020eac5a8a057cb9"
server_key_iv: "444a938cdfe565b10c18fe1f3dc06059"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.128875 19514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:28.140057 19514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:28.143301 19514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:28.143548 19514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:28.149453 19514 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:39429
I20260812 20:58:28.149507 19623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:39429 every 8 connection(s)
I20260812 20:58:28.150072 19514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:28.151399 19626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:28.152235 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 19514
I20260812 20:58:28.152419 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:28.152669 10361 external_mini_cluster.cc:1428] Setting key e7d028e14671b4d828248670a02f5693
I20260812 20:58:28.155491 19626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d: Bootstrap starting.
I20260812 20:58:28.156286 19626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:28.156636 19626 log.cc:824] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:28.157575 19626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d: No bootstrap required, opened a new log
I20260812 20:58:28.159868 19626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242ad90d42ac491f87880d212c38242d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39429 } }
I20260812 20:58:28.160106 19626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:28.160159 19626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242ad90d42ac491f87880d212c38242d, State: Initialized, Role: FOLLOWER
I20260812 20:58:28.160333 19626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242ad90d42ac491f87880d212c38242d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39429 } }
I20260812 20:58:28.160432 19626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:28.160470 19626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:28.160533 19626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 0 FOLLOWER]: Advancing to term 1
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:28.161401 19626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242ad90d42ac491f87880d212c38242d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39429 } }
I20260812 20:58:28.161556 19626 leader_election.cc:302] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 242ad90d42ac491f87880d212c38242d; no voters:
I20260812 20:58:28.161792 19626 leader_election.cc:288] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:28.162029 19635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:28.162153 19626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:28.162204 19635 raft_consensus.cc:686] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [term 1 LEADER]: Becoming Leader. State: Replica: 242ad90d42ac491f87880d212c38242d, State: Running, Role: LEADER
I20260812 20:58:28.162312 19635 consensus_queue.cc:237] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242ad90d42ac491f87880d212c38242d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39429 } }
I20260812 20:58:28.162734 19635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "242ad90d42ac491f87880d212c38242d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242ad90d42ac491f87880d212c38242d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39429 } } }
I20260812 20:58:28.162814 19635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:28.162935 19636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 242ad90d42ac491f87880d212c38242d. Latest consensus state: current_term: 1 leader_uuid: "242ad90d42ac491f87880d212c38242d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242ad90d42ac491f87880d212c38242d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39429 } } }
I20260812 20:58:28.163074 19636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:28.163367 19643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:28.164690 19643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:28.166759 19660 mvcc.cc:205] Tried to move back new op lower bound from 7317783790247768064 to 7317783790233292800. Current Snapshot: MvccSnapshot[applied={T|T < 7317783790247768064}]
I20260812 20:58:28.166790 19632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.153431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43404 (local address 127.10.30.126:39429)
0812 20:58:28.153705 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.153717 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.153757 (+ 40us) server_negotiation.cc:407] Connection header received
0812 20:58:28.154444 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.154464 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.154547 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.154737 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.155573 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.156755 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.157601 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.158114 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.158266 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.161455 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:28.161467 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:28.161468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:28.161483 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:28.164137 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.164722 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.164726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.164727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.164876 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.165215 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.165216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.165216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.165590 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:28.166243 (+ 653us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:28.166334 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 20:58:28.166514 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":134,"threads_started":1}
I20260812 20:58:28.167673 19643 catalog_manager.cc:1347] Generated new cluster ID: 59761811172a4fecaee1daa1c9bb1eeb
I20260812 20:58:28.167730 19643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:28.192883 19643 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:28.193624 19643 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:28.199070 19643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 242ad90d42ac491f87880d212c38242d: Generated new TSK 0
I20260812 20:58:28.199347 19643 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:28.244823 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39429
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:28.364782 19665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:28.365024 19665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:28.365052 19665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:28.366230 19665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:28.366269 19665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:28.366297 19665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:28.367887 19665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:28.368121 19665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:28.368341 19665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:28.374686 19687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:28.374712 19681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:28.374686 19683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:28.375097 19665 server_base.cc:1034] running on GCE node
I20260812 20:58:28.375329 19665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:28.375608 19665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:28.376775 19665 hybrid_clock.cc:648] HybridClock initialized: now 1786568308376725 us; error 69 us; skew 500 ppm
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.383141 19665 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:28.383724 19665 webserver.cc:460] Webserver started at http://127.10.30.65:33369/ using document root <none> and password file <none>
I20260812 20:58:28.384033 19665 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:28.384107 19665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:28.384286 19665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:28.385527 19665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "04bad7465fe44127a2077c185e71379e"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "fd92cf7daaef559acf5e35c1622608b5"
server_key_iv: "42cfe648b014035c52b5b016c429b819"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.385941 19665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "04bad7465fe44127a2077c185e71379e"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "fd92cf7daaef559acf5e35c1622608b5"
server_key_iv: "42cfe648b014035c52b5b016c429b819"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.387540 19665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 20:58:28.388561 19698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.388846 19665 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:28.389053 19665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "04bad7465fe44127a2077c185e71379e"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "fd92cf7daaef559acf5e35c1622608b5"
server_key_iv: "42cfe648b014035c52b5b016c429b819"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.389148 19665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:28.399194 19665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:28.401669 19665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:28.401862 19665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:28.402187 19665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:28.402570 19665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:28.402626 19665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.402671 19665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:28.402717 19665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.410460 19665 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:36695
I20260812 20:58:28.410517 19907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:36695 every 8 connection(s)
I20260812 20:58:28.410924 19665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:58:28.413849 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 19665
I20260812 20:58:28.414059 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:28.414286 10361 external_mini_cluster.cc:1428] Setting key d7b8e55780c57fb0e5741feb480c229f
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:28.423695 19632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.411993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:47649 (local address 127.10.30.126:39429)
0812 20:58:28.412075 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.412078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.412323 (+ 245us) server_negotiation.cc:407] Connection header received
0812 20:58:28.413430 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.413432 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.413447 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.413527 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.414799 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.415564 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.417204 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.417480 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.417572 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.420391 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:28.420394 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:28.420394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:28.420404 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:28.422002 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.422494 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.422495 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.422496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.422564 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.422849 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.422850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.422851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.423054 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:28.423132 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:28.423462 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 20:58:28.423582 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 20:58:28.423936 19911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.411886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39429 (local address 127.10.30.65:47649)
0812 20:58:28.412126 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:28.412176 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:28.413283 (+ 1107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:28.413669 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:28.413675 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:28.414143 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:28.414629 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:28.414658 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.415669 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.415670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:28.417081 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:28.417085 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.417600 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.417601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:28.417792 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.418509 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:28.418519 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:28.420264 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:28.422110 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:28.422119 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:28.422122 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:28.422401 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:28.422643 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:28.422644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:28.422644 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:28.422770 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:28.423128 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:28.423137 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:28.423304 (+ 167us) client_negotiation.cc:769] Sending connection context
0812 20:58:28.423444 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 20:58:28.423637 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":155,"threads_started":1}
I20260812 20:58:28.424664 19909 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39429
I20260812 20:58:28.424783 19909 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:28.425043 19909 heartbeater.cc:511] Master 127.10.30.126:39429 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
I20260812 20:58:28.425851 19564 ts_manager.cc:194] Registered new tserver with Master: 04bad7465fe44127a2077c185e71379e (127.10.30.65:36695)
I20260812 20:58:28.426599 19564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:47649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:28.452284 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39429
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:28.550906 19917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:28.551195 19917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:28.551223 19917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:28.552516 19917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:28.552580 19917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:28.552613 19917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:28.554287 19917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:28.554611 19917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:28.554888 19917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:28.560859 19935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:28.560844 19929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:28.560848 19931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:28.561299 19917 server_base.cc:1034] running on GCE node
I20260812 20:58:28.561620 19917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:28.561890 19917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:28.563078 19917 hybrid_clock.cc:648] HybridClock initialized: now 1786568308563047 us; error 41 us; skew 500 ppm
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.566253 19917 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:28.566762 19917 webserver.cc:460] Webserver started at http://127.10.30.66:46547/ using document root <none> and password file <none>
I20260812 20:58:28.567059 19917 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:28.567113 19917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:28.567224 19917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:28.568424 19917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "3cc60f4e214647c6bbc06e4020a35bd9"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "52d18c0d0b99d62417ed67520e2598ef"
server_key_iv: "0af36cf15e152d093ec1e533d58b6697"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.568780 19917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "3cc60f4e214647c6bbc06e4020a35bd9"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "52d18c0d0b99d62417ed67520e2598ef"
server_key_iv: "0af36cf15e152d093ec1e533d58b6697"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.570298 19917 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 20:58:28.571380 19945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.571609 19917 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:28.571709 19917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "3cc60f4e214647c6bbc06e4020a35bd9"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "52d18c0d0b99d62417ed67520e2598ef"
server_key_iv: "0af36cf15e152d093ec1e533d58b6697"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.571776 19917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:28.584227 19917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:28.586833 19917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:28.586983 19917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:28.587392 19917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:28.587749 19917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:28.587785 19917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.587813 19917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:28.587826 19917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.595621 19917 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:46747
I20260812 20:58:28.595700 20144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:46747 every 8 connection(s)
I20260812 20:58:28.596112 19917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:28.600160 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 19917
I20260812 20:58:28.600337 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:28.600577 10361 external_mini_cluster.cc:1428] Setting key 78fba62721b3fc0e3dc74d78240fb2c5
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:28.608201 19632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.597192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:38695 (local address 127.10.30.126:39429)
0812 20:58:28.597311 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.597314 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.597514 (+ 200us) server_negotiation.cc:407] Connection header received
0812 20:58:28.598741 (+ 1227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.598743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.598760 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.598829 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.599689 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.600249 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.601811 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.602036 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.602117 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.604842 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:28.604844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:28.604844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:28.604852 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:28.606517 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.607079 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.607081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.607082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.607154 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.607448 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.607449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.607449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.607587 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:28.607664 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:28.607999 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 20:58:28.608096 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 20:58:28.608464 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.597081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39429 (local address 127.10.30.66:38695)
0812 20:58:28.597339 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:28.597398 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:28.598599 (+ 1201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:28.598920 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:28.598933 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:28.599315 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:28.599563 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:28.599568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.600358 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.600360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:28.601711 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:28.601714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.602125 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.602127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:28.602278 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.602988 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:28.603051 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:28.604721 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:28.606631 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:28.606641 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:28.606644 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:28.606941 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:28.607227 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:28.607228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:28.607228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:28.607367 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:28.607665 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:28.607675 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:28.607838 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 20:58:28.607953 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 20:58:28.608153 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":119,"threads_started":1}
I20260812 20:58:28.609167 20148 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39429
I20260812 20:58:28.609318 20148 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:28.609553 20148 heartbeater.cc:511] Master 127.10.30.126:39429 requested a full tablet report, sending...
I20260812 20:58:28.610036 19564 ts_manager.cc:194] Registered new tserver with Master: 3cc60f4e214647c6bbc06e4020a35bd9 (127.10.30.66:46747)
I20260812 20:58:28.610478 19564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:38695
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:28.635468 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39429
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:28.735558 20162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:28.735842 20162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:28.735872 20162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:28.737124 20162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:28.737160 20162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:28.737187 20162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:28.738780 20162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:28.739140 20162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:28.739394 20162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:28.745853 20174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:28.746028 20162 server_base.cc:1034] running on GCE node
W20260812 20:58:28.745869 20170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:28.745827 20178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:28.746407 20162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:28.746790 20162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:28.747994 20162 hybrid_clock.cc:648] HybridClock initialized: now 1786568308747967 us; error 41 us; skew 500 ppm
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.751327 20162 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:28.751911 20162 webserver.cc:460] Webserver started at http://127.10.30.67:46645/ using document root <none> and password file <none>
I20260812 20:58:28.752224 20162 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:28.752292 20162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:28.752460 20162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:28.753788 20162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "72353951d2c045a287fb189cc6404cc0"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "7b939530f06e9d6835ff19404546ecdc"
server_key_iv: "fc46e90e2a807a3a168be7b9f96c97ae"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.754244 20162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "72353951d2c045a287fb189cc6404cc0"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "7b939530f06e9d6835ff19404546ecdc"
server_key_iv: "fc46e90e2a807a3a168be7b9f96c97ae"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.756188 20162 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:28.757243 20186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.757472 20162 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:28.757597 20162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "72353951d2c045a287fb189cc6404cc0"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-h3ft"
server_key: "7b939530f06e9d6835ff19404546ecdc"
server_key_iv: "fc46e90e2a807a3a168be7b9f96c97ae"
server_key_version: "encryptionkey@0"
I20260812 20:58:28.757683 20162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:28.779426 20162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:28.782323 20162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:28.782541 20162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:28.782868 20162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:28.783319 20162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:28.783378 20162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.783425 20162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:28.783458 20162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.791071 20162 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:34105
I20260812 20:58:28.791153 20382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:34105 every 8 connection(s)
I20260812 20:58:28.791591 20162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:28.793174 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 20162
I20260812 20:58:28.793287 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:28.793490 10361 external_mini_cluster.cc:1428] Setting key 51b9bf1ada44b7421fd5336a6f6cc6f6
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:28.803848 19632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.792542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:57021 (local address 127.10.30.126:39429)
0812 20:58:28.792607 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.792610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.792916 (+ 306us) server_negotiation.cc:407] Connection header received
0812 20:58:28.794510 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.794512 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.794527 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.794575 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.795544 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.796120 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.797253 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.797475 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.797562 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.800456 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:28.800458 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:28.800458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:28.800470 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:28.802147 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.802656 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.802658 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.802659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.802728 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.803061 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.803062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.803062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.803206 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:28.803295 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:28.803630 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 20:58:28.803733 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 20:58:28.804088 20386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.792520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39429 (local address 127.10.30.67:57021)
0812 20:58:28.792748 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:28.792795 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:28.794374 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:28.794676 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:28.794681 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:28.795173 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:28.795434 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:28.795441 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.796236 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.796237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:28.797148 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:28.797150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.797575 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.797576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:28.797732 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.798426 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:28.798438 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:28.800331 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:28.802263 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:28.802275 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:28.802278 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:28.802568 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:28.802809 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:28.802810 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:28.802810 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:28.802942 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:28.803282 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:28.803290 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:28.803473 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 20:58:28.803593 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 20:58:28.803797 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":121,"threads_started":1}
I20260812 20:58:28.804741 20383 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39429
I20260812 20:58:28.804858 20383 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:28.805248 20383 heartbeater.cc:511] Master 127.10.30.126:39429 requested a full tablet report, sending...
I20260812 20:58:28.805928 19564 ts_manager.cc:194] Registered new tserver with Master: 72353951d2c045a287fb189cc6404cc0 (127.10.30.67:34105)
I20260812 20:58:28.806380 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:58:28.806566 19564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:57021
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/test-admin.keytab.
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.829588 10361 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 20:58:28.832139 20395 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:28.830773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45314 (local address 127.10.30.65:36695)
0812 20:58:28.831185 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.831192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.831205 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:28.831242 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.831244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.831262 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.831354 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.832001 (+ 647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45314: BlockingRecv error: recv got EOF from 127.0.0.1:45314 (error 108)
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":160,"threads_started":1}
W20260812 20:58:28.832190 10361 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5cc' of type FILE
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.833529 10361 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.834613 10361 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:58:28.845743 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.835328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45320 (local address 127.10.30.65:36695)
0812 20:58:28.835396 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.835398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.835409 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:28.835472 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.835473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.835486 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.835554 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.835996 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.836830 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.837634 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.838072 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.838137 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.840981 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:28.840997 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:28.840997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:28.841008 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:28.843758 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.844382 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.844387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.844387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.844511 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.844810 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.844811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.844811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.845090 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:28.845312 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:28.845447 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 20:58:28.845569 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 20:58:28.849602 20395 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:28.848771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45332 (local address 127.10.30.65:36695)
0812 20:58:28.848840 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.848842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.848851 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:28.848889 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.848890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.848903 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.848988 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.849519 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45332: BlockingRecv error: recv got EOF from 127.0.0.1:45332 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 20:58:28.849745 10361 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5cc' of type FILE
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.851424 10361 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.852708 10361 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:58:28.862668 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.854208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.10.30.65:36695)
0812 20:58:28.854267 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.854270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.854281 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:28.854319 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.854319 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.854336 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.854418 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.854891 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.855607 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.856418 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.856658 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.856727 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.859440 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:28.859442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:28.859442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:28.859450 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:28.861223 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.861604 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.861606 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.861606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.861669 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.862058 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.862059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.862060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.862250 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:28.862349 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:28.862485 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 20:58:28.862576 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 20:58:28.865100 20395 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:28.864164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45346 (local address 127.10.30.65:36695)
0812 20:58:28.864209 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.864212 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.864327 (+ 115us) server_negotiation.cc:407] Connection header received
0812 20:58:28.864412 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.864413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.864424 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.864491 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.865033 (+ 542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45346: BlockingRecv error: recv got EOF from 127.0.0.1:45346 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 20:58:28.865168 10361 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786568275908695-10361-0/krb5kdc/krb5cc' of type FILE
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.866448 10361 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:28.867698 10361 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 20:58:28 dist-test-slave-h3ft krb5kdc[19490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 20:58:28.876909 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:28.868430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45360 (local address 127.10.30.65:36695)
0812 20:58:28.868524 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:28.868526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:28.868625 (+ 99us) server_negotiation.cc:407] Connection header received
0812 20:58:28.868723 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:28.868724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:28.868739 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:28.868817 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:28.869513 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.870122 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.870889 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:28.871174 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:28.871266 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:28.873797 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:28.873799 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:28.873800 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:28.873817 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:28.875515 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.875955 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.875957 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.875958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.876032 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:28.876263 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:28.876264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:28.876265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:28.876403 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:28.876560 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:28.876662 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 20:58:28.876762 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 20:58:28.877841 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 19665
I20260812 20:58:28.894589 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 19917
I20260812 20:58:28.917689 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 20162
I20260812 20:58:28.934628 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 19514
2026-08-12T20:58:28Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2521 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:29 dist-test-slave-h3ft krb5kdc[20416](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:29 dist-test-slave-h3ft krb5kdc[20416](info): set up 2 sockets
Aug 12 20:58:29 dist-test-slave-h3ft krb5kdc[20416](info): commencing operation
krb5kdc: starting...
W20260812 20:58:30.317466 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:30 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.126.keytab.
Entry for principal oryx/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.126.keytab.
I20260812 20:58:30.475499 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44261
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.126.keytab
--principal=oryx/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:44261
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:30.573648 20434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:30.573972 20434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:30.574018 20434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:30.575412 20434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:30.575495 20434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:30.575520 20434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:30.575548 20434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:30.575596 20434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:30.577368 20434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:44261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.126.keytab
--principal=oryx/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:30.577702 20434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:30.577998 20434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:30.583770 20444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:30.583784 20448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:30.583786 20442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:30.584216 20434 server_base.cc:1034] running on GCE node
I20260812 20:58:30.584596 20434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:30.584987 20434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:30.586194 20434 hybrid_clock.cc:648] HybridClock initialized: now 1786568310586169 us; error 42 us; skew 500 ppm
Aug 12 20:58:30 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:30.589318 20434 init.cc:377] Logged in from keytab as oryx/127.10.30.126@KRBTEST.COM (short username oryx)
I20260812 20:58:30.589913 20434 webserver.cc:460] Webserver started at http://127.10.30.126:34855/ using document root <none> and password file <none>
I20260812 20:58:30.590193 20434 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:30.590266 20434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:30.590430 20434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:30.591770 20434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "c6df37556d084a8c8aaefdba5d775475"
format_stamp: "Formatted at 2026-08-12 20:58:30 on dist-test-slave-h3ft"
server_key: "4eab694466dfd2af76cffc659a042b73"
server_key_iv: "02224f464e2001624e15c01e8b1652a5"
server_key_version: "encryptionkey@0"
I20260812 20:58:30.592197 20434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "c6df37556d084a8c8aaefdba5d775475"
format_stamp: "Formatted at 2026-08-12 20:58:30 on dist-test-slave-h3ft"
server_key: "4eab694466dfd2af76cffc659a042b73"
server_key_iv: "02224f464e2001624e15c01e8b1652a5"
server_key_version: "encryptionkey@0"
I20260812 20:58:30.593787 20434 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 20:58:30.594755 20458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:30.595136 20434 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:30.595274 20434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "c6df37556d084a8c8aaefdba5d775475"
format_stamp: "Formatted at 2026-08-12 20:58:30 on dist-test-slave-h3ft"
server_key: "4eab694466dfd2af76cffc659a042b73"
server_key_iv: "02224f464e2001624e15c01e8b1652a5"
server_key_version: "encryptionkey@0"
I20260812 20:58:30.595366 20434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:30.610199 20434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:30.613080 20434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:30.613274 20434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:30.618531 20434 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:44261
I20260812 20:58:30.618582 20557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:44261 every 8 connection(s)
I20260812 20:58:30.619266 20434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:30.620550 20559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:30.623329 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 20434
I20260812 20:58:30.623497 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:30.623754 10361 external_mini_cluster.cc:1428] Setting key 6481436e4cf5f8855ce5d64fb02e0159
I20260812 20:58:30.623965 20559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: Bootstrap starting.
I20260812 20:58:30.624943 20559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:30.625336 20559 log.cc:824] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:30.626407 20559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: No bootstrap required, opened a new log
I20260812 20:58:30.629004 20559 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } }
I20260812 20:58:30.629199 20559 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:30.629225 20559 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6df37556d084a8c8aaefdba5d775475, State: Initialized, Role: FOLLOWER
I20260812 20:58:30.629395 20559 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } }
I20260812 20:58:30.629500 20559 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:30.629554 20559 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:30.629642 20559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:30.630404 20559 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } }
I20260812 20:58:30.630553 20559 leader_election.cc:302] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6df37556d084a8c8aaefdba5d775475; no voters:
I20260812 20:58:30.630802 20559 leader_election.cc:288] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:30.630834 20578 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:30.630966 20578 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 1 LEADER]: Becoming Leader. State: Replica: c6df37556d084a8c8aaefdba5d775475, State: Running, Role: LEADER
I20260812 20:58:30.631108 20578 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } }
I20260812 20:58:30.631196 20559 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:30.631515 20578 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } }
I20260812 20:58:30.631601 20578 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:30.631765 20578 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6df37556d084a8c8aaefdba5d775475. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } }
I20260812 20:58:30.631899 20578 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
Aug 12 20:58:30 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:30.632627 20588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:30.633270 20588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:30.636044 20588 catalog_manager.cc:1347] Generated new cluster ID: f5f32186dfdf4236b7521f088a015316
I20260812 20:58:30.636140 20588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:30.637504 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:30.624489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39884 (local address 127.10.30.126:44261)
0812 20:58:30.624751 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:30.624761 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:30.624793 (+ 32us) server_negotiation.cc:407] Connection header received
0812 20:58:30.625416 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:30.625428 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:30.625506 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:30.625693 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:30.626591 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:30.627692 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:30.628914 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:30.629524 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:30.629652 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:30.633115 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:30.633121 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:30.633122 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:30.633137 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:30.635582 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:30.635992 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:30.635995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:30.635996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:30.636112 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:30.636352 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:30.636354 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:30.636354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:30.636737 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:30.636934 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:30.637069 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 20:58:30.637243 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":121,"threads_started":1}
I20260812 20:58:30.655495 20588 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:30.656143 20588 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:30.662410 20588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: Generated new TSK 0
I20260812 20:58:30.662672 20588 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab.
Entry for principal oryx/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab.
I20260812 20:58:30.703397 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44261
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab
--principal=oryx/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:30.806954 20617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:30.807293 20617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:30.807322 20617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:30.808674 20617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:30.808737 20617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:30.808768 20617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:30.810478 20617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab
--principal=oryx/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:30.810814 20617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:30.811154 20617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:30.817376 20623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:30.817392 20624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:30.817608 20617 server_base.cc:1034] running on GCE node
W20260812 20:58:30.817392 20627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:30.817924 20617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:30.818233 20617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:30.819383 20617 hybrid_clock.cc:648] HybridClock initialized: now 1786568310819369 us; error 33 us; skew 500 ppm
Aug 12 20:58:30 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:30.822707 20617 init.cc:377] Logged in from keytab as oryx/127.10.30.65@KRBTEST.COM (short username oryx)
I20260812 20:58:30.823326 20617 webserver.cc:460] Webserver started at http://127.10.30.65:38041/ using document root <none> and password file <none>
I20260812 20:58:30.823611 20617 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:30.823662 20617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:30.823813 20617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:30.825142 20617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "75f973af41194e19bc44b5aed71de35b"
format_stamp: "Formatted at 2026-08-12 20:58:30 on dist-test-slave-h3ft"
server_key: "12d456fbe3749160c85503a20c75ddaa"
server_key_iv: "5638b8f8bde111d2d80668883c486d16"
server_key_version: "encryptionkey@0"
I20260812 20:58:30.825572 20617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "75f973af41194e19bc44b5aed71de35b"
format_stamp: "Formatted at 2026-08-12 20:58:30 on dist-test-slave-h3ft"
server_key: "12d456fbe3749160c85503a20c75ddaa"
server_key_iv: "5638b8f8bde111d2d80668883c486d16"
server_key_version: "encryptionkey@0"
I20260812 20:58:30.827281 20617 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 20:58:30.828207 20638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:30.828442 20617 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:30.828554 20617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "75f973af41194e19bc44b5aed71de35b"
format_stamp: "Formatted at 2026-08-12 20:58:30 on dist-test-slave-h3ft"
server_key: "12d456fbe3749160c85503a20c75ddaa"
server_key_iv: "5638b8f8bde111d2d80668883c486d16"
server_key_version: "encryptionkey@0"
I20260812 20:58:30.828637 20617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:30.847877 20617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:30.851526 20617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:30.851751 20617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:30.852054 20617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:30.852578 20617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:30.852706 20617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:30.852762 20617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:30.852782 20617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:30.861366 20617 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:39575
I20260812 20:58:30.861408 20838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:39575 every 8 connection(s)
I20260812 20:58:30.861929 20617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
Aug 12 20:58:30 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:30.871872 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 20617
I20260812 20:58:30.872037 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:30.872298 10361 external_mini_cluster.cc:1428] Setting key 38fe7cd1c95ebb4ae27f2988265ff780
I20260812 20:58:30.874918 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:30.862964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:58627 (local address 127.10.30.126:44261)
0812 20:58:30.863067 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:30.863070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:30.863307 (+ 237us) server_negotiation.cc:407] Connection header received
0812 20:58:30.864079 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:30.864080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:30.864098 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:30.864152 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:30.865353 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:30.865937 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:30.867155 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:30.867410 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:30.867508 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:30.870341 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:30.870344 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:30.870344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:30.870356 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:30.872520 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:30.873348 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:30.873349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:30.873349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:30.873453 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:30.873832 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:30.873833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:30.873834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:30.874022 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:30.874112 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:30.874615 (+ 503us) server_negotiation.cc:299] Negotiation successful
0812 20:58:30.874757 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 20:58:30.875134 20842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:30.862900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:58627)
0812 20:58:30.863149 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:30.863198 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:30.863937 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:30.864247 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:30.864251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:30.864968 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:30.865226 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:30.865232 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:30.866063 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:30.866064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:30.866993 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:30.867050 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:30.867524 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:30.867525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:30.867682 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:30.868363 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:30.868374 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:30.870194 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:30.872669 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:30.872687 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:30.872690 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:30.873249 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:30.873573 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:30.873574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:30.873574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:30.873739 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:30.874267 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:30.874275 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:30.874451 (+ 176us) client_negotiation.cc:769] Sending connection context
0812 20:58:30.874567 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 20:58:30.874746 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":157,"threads_started":1}
I20260812 20:58:30.875767 20839 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44261
I20260812 20:58:30.875916 20839 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:30.876194 20839 heartbeater.cc:511] Master 127.10.30.126:44261 requested a full tablet report, sending...
I20260812 20:58:30.876886 20493 ts_manager.cc:194] Registered new tserver with Master: 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575)
I20260812 20:58:30.877627 20493 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:58627
WARNING: no policy specified for oryx/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab.
Entry for principal oryx/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab.
I20260812 20:58:30.912213 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44261
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab
--principal=oryx/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:31.011626 20846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:31.011969 20846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:31.012018 20846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:31.013463 20846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:31.013549 20846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:31.013599 20846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:31.015429 20846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab
--principal=oryx/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:31.015762 20846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:31.016093 20846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:31.022382 20859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:31.022639 20846 server_base.cc:1034] running on GCE node
W20260812 20:58:31.022725 20856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.022728 20854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:31.023175 20846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:31.023559 20846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:31.024796 20846 hybrid_clock.cc:648] HybridClock initialized: now 1786568311024781 us; error 54 us; skew 500 ppm
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:31.028330 20846 init.cc:377] Logged in from keytab as oryx/127.10.30.66@KRBTEST.COM (short username oryx)
I20260812 20:58:31.028954 20846 webserver.cc:460] Webserver started at http://127.10.30.66:36031/ using document root <none> and password file <none>
I20260812 20:58:31.029273 20846 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:31.029349 20846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:31.029543 20846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:31.030882 20846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "70d6e3db3fe3e8c698ab9a7b3713c81a"
server_key_iv: "fb1fca6bbcae5504dad5b93f6fe9d635"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.031421 20846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "70d6e3db3fe3e8c698ab9a7b3713c81a"
server_key_iv: "fb1fca6bbcae5504dad5b93f6fe9d635"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.033381 20846 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:31.034358 20870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.034694 20846 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:31.034825 20846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "70d6e3db3fe3e8c698ab9a7b3713c81a"
server_key_iv: "fb1fca6bbcae5504dad5b93f6fe9d635"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.034937 20846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:31.049418 20846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:31.052512 20846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:31.052747 20846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:31.053081 20846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:31.053509 20846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:31.053571 20846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.053620 20846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:31.053649 20846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.061796 20846 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:35553
I20260812 20:58:31.061903 21060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:35553 every 8 connection(s)
I20260812 20:58:31.062333 20846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:31.070616 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 20846
I20260812 20:58:31.070756 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:31.071131 10361 external_mini_cluster.cc:1428] Setting key 5afcc9f115c9c2ecb281b0511d39e230
I20260812 20:58:31.075860 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.063379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:45715 (local address 127.10.30.126:44261)
0812 20:58:31.063609 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.063613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.063859 (+ 246us) server_negotiation.cc:407] Connection header received
0812 20:58:31.064654 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.064656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.064674 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.064771 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.066075 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.066640 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.067977 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.068196 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.068263 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.071601 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.071603 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.071604 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.071613 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.073598 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.074318 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.074319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.074319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.074396 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.074839 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.074841 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.074841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.075105 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.075206 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.075566 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.075711 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 20:58:31.075943 21071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.063342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:45715)
0812 20:58:31.063693 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.063743 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.064469 (+ 726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.064855 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.064860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.065676 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.065945 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.065951 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.066752 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.066753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.067846 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.067850 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.068301 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.068302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.068433 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.069215 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.069226 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.071425 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.073707 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.073721 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.073725 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.074206 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.074507 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.074508 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.074509 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.074721 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.075200 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.075208 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.075392 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.075511 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.075698 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":112,"threads_started":1}
I20260812 20:58:31.076848 21065 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44261
I20260812 20:58:31.077014 21065 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:31.077292 21065 heartbeater.cc:511] Master 127.10.30.126:44261 requested a full tablet report, sending...
I20260812 20:58:31.077872 20493 ts_manager.cc:194] Registered new tserver with Master: ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553)
I20260812 20:58:31.078354 20493 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:45715
WARNING: no policy specified for oryx/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab.
Entry for principal oryx/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab.
I20260812 20:58:31.112600 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44261
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab
--principal=oryx/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:31.220935 21076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:31.221202 21076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:31.221231 21076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:31.222621 21076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:31.222715 21076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:31.222767 21076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:31.224854 21076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab
--principal=oryx/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:31.225204 21076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:31.225508 21076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:31.232367 21087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.232362 21094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.232362 21088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:31.233026 21076 server_base.cc:1034] running on GCE node
I20260812 20:58:31.233335 21076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:31.233678 21076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:31.234882 21076 hybrid_clock.cc:648] HybridClock initialized: now 1786568311234866 us; error 32 us; skew 500 ppm
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:31.238334 21076 init.cc:377] Logged in from keytab as oryx/127.10.30.67@KRBTEST.COM (short username oryx)
I20260812 20:58:31.238991 21076 webserver.cc:460] Webserver started at http://127.10.30.67:43265/ using document root <none> and password file <none>
I20260812 20:58:31.239416 21076 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:31.239492 21076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:31.239663 21076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:31.241065 21076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "d699cc3f6d964d5780d364c1df58e53f"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "6ef15fbbf395f48d10cf3d698ec0d84a"
server_key_iv: "4b5a11b64afe12a5d4642541b9b73107"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.241518 21076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "d699cc3f6d964d5780d364c1df58e53f"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "6ef15fbbf395f48d10cf3d698ec0d84a"
server_key_iv: "4b5a11b64afe12a5d4642541b9b73107"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.243319 21076 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:31.244455 21108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.244699 21076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:31.244828 21076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "d699cc3f6d964d5780d364c1df58e53f"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "6ef15fbbf395f48d10cf3d698ec0d84a"
server_key_iv: "4b5a11b64afe12a5d4642541b9b73107"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.244926 21076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:31.265740 21076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:31.268664 21076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:31.268879 21076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:31.269238 21076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:31.269655 21076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:31.269716 21076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.269770 21076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:31.269801 21076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.278353 21076 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:34185
I20260812 20:58:31.278456 21296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:34185 every 8 connection(s)
I20260812 20:58:31.278898 21076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:31.281265 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 21076
I20260812 20:58:31.281441 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:31.281670 10361 external_mini_cluster.cc:1428] Setting key 44db7591d9bfdea73ae51743a4eaf260
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:31.291842 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.280032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:45551 (local address 127.10.30.126:44261)
0812 20:58:31.280126 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.280128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.280415 (+ 287us) server_negotiation.cc:407] Connection header received
0812 20:58:31.281134 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.281136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.281154 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.281256 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.283112 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.283784 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.285031 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.285274 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.285373 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.288235 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.288237 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.288238 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.288249 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.290018 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.290545 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.290546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.290547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.290623 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.290931 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.290932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.290933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.291152 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.291239 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.291603 (+ 364us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.291715 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:31.292223 21302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.279996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:45551)
0812 20:58:31.280238 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.280299 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.280988 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.281338 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.281371 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.282548 (+ 1177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.282974 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.282984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.283906 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.283907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.284908 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.284911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.285390 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.285392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.285565 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.286316 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.286327 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.288113 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.290144 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.290153 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.290156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.290453 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.290705 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.290706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.290707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.290847 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.291238 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.291248 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.291442 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.291580 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.291800 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":115,"threads_started":1}
I20260812 20:58:31.292812 21298 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44261
I20260812 20:58:31.292943 21298 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:31.293159 21298 heartbeater.cc:511] Master 127.10.30.126:44261 requested a full tablet report, sending...
I20260812 20:58:31.293776 20493 ts_manager.cc:194] Registered new tserver with Master: d699cc3f6d964d5780d364c1df58e53f (127.10.30.67:34185)
I20260812 20:58:31.294413 20493 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:45551
I20260812 20:58:31.294426 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.30.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.125.keytab.
Entry for principal oryx/127.10.30.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.125.keytab.
I20260812 20:58:31.331881 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.125:44391
--webserver_interface=127.10.30.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.125.keytab
--principal=oryx/127.10.30.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:44261,127.10.30.125:44391
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:31.430964 21305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:31.431351 21305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:31.431380 21305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:31.433051 21305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:31.433109 21305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:31.433125 21305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:31.433137 21305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:31.433151 21305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:31.434914 21305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:44261,127.10.30.125:44391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.125.keytab
--principal=oryx/127.10.30.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.125:44391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.30.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
W20260812 20:58:31.435089 21305 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.30.126:44261,127.10.30.125:44391'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 20:58:31.435246 21305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:31.435480 21305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:31.441672 21314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.441684 21313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.441685 21317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:31.441730 21305 server_base.cc:1034] running on GCE node
I20260812 20:58:31.442224 21305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:31.442588 21305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:31.443799 21305 hybrid_clock.cc:648] HybridClock initialized: now 1786568311443782 us; error 53 us; skew 500 ppm
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:31.447278 21305 init.cc:377] Logged in from keytab as oryx/127.10.30.125@KRBTEST.COM (short username oryx)
I20260812 20:58:31.447938 21305 webserver.cc:460] Webserver started at http://127.10.30.125:36429/ using document root <none> and password file <none>
I20260812 20:58:31.448316 21305 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:31.448426 21305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:31.448602 21305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:31.449955 21305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data/instance:
uuid: "dc14b6da438746ab92e13d40d0479208"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "61f15c1b1cebbd9e5e592ccc8750db59"
server_key_iv: "b808b64efabb0d2f8f9d65289040ac8c"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.450328 21305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal/instance:
uuid: "dc14b6da438746ab92e13d40d0479208"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "61f15c1b1cebbd9e5e592ccc8750db59"
server_key_iv: "b808b64efabb0d2f8f9d65289040ac8c"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.451987 21305 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 20:58:31.452904 21331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.453171 21305 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:31.453259 21305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
uuid: "dc14b6da438746ab92e13d40d0479208"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "61f15c1b1cebbd9e5e592ccc8750db59"
server_key_iv: "b808b64efabb0d2f8f9d65289040ac8c"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.453326 21305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:31.483318 21305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:31.486207 21305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:31.486367 21305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:31.491959 21305 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.125:44391
I20260812 20:58:31.492007 21414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.125:44391 every 8 connection(s)
I20260812 20:58:31.492465 21305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
I20260812 20:58:31.493752 21415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:31.495774 21415 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } has no permanent_uuid. Determining permanent_uuid...
I20260812 20:58:31.500837 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 21305
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.125@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:31.507669 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.496765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39890 (local address 127.10.30.126:44261)
0812 20:58:31.496847 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.496850 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.497107 (+ 257us) server_negotiation.cc:407] Connection header received
0812 20:58:31.497650 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.497652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.497667 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.497752 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.498688 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.499351 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.500514 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.500866 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.500960 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.503935 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.503938 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.503938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.503948 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.505668 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.506346 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.506347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.506348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.506418 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.506758 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.506759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.506759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.506937 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.506996 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.507438 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.507545 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 20:58:31.507761 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.496659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:39890)
0812 20:58:31.496910 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.496970 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.497540 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.497957 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.497962 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.498318 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.498580 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.498585 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.499472 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.499473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.500395 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.500398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.500976 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.500977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.501200 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.502025 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.502037 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.503815 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.505770 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.505778 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.505780 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.506250 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.506495 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.506497 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.506497 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.506672 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.507039 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.507047 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.507257 (+ 210us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.507371 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.507523 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":114,"threads_started":1}
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.30.125@KRBTEST.COM
I20260812 20:58:31.508684 21415 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } has no permanent_uuid. Determining permanent_uuid...
I20260812 20:58:31.512068 21420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.501856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60906 (local address 127.10.30.125:44391)
0812 20:58:31.502111 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.502118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.502147 (+ 29us) server_negotiation.cc:407] Connection header received
0812 20:58:31.502174 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.502177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.502207 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.502297 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.503093 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.503923 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.505014 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.505340 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.505427 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.508475 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.508485 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.508485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.508493 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.510521 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.510966 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.510969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.510969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.511113 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.511360 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.511361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.511361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.511568 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.511748 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.511829 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.511943 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":150,"threads_started":1}
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.125@KRBTEST.COM for oryx/127.10.30.125@KRBTEST.COM
I20260812 20:58:31.517700 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.509021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.0.0.1:60918)
0812 20:58:31.509071 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.509081 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.509116 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.509398 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.509399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.509609 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.509674 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.509676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.510397 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.510398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.511182 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.511185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.511647 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.511648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.511729 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.512430 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.512435 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.513813 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.516310 (+ 2497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.516311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.516311 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.516535 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.516805 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.516806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.516807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.516958 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.517295 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.517296 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.517338 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.517412 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.517545 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 20:58:31.517758 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.509076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60918 (local address 127.10.30.125:44391)
0812 20:58:31.509267 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.509268 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.509274 (+ 6us) server_negotiation.cc:407] Connection header received
0812 20:58:31.509289 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.509289 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.509298 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.509377 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.509760 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.510302 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.511255 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.511558 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.511636 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.513914 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.513916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.513916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.513923 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.516207 (+ 2284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.516628 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.516629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.516629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.516706 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.517041 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.517042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.517043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.517203 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.517270 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.517463 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.517613 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":170,"thread_start_us":113,"threads_started":1}
I20260812 20:58:31.520893 21415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Bootstrap starting.
I20260812 20:58:31.522058 21415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:31.522483 21415 log.cc:824] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:31.523780 21415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: No bootstrap required, opened a new log
I20260812 20:58:31.526904 21415 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } }
I20260812 20:58:31.527258 21415 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:31.527320 21415 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc14b6da438746ab92e13d40d0479208, State: Initialized, Role: FOLLOWER
I20260812 20:58:31.527529 21415 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } }
I20260812 20:58:31.528825 21426 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } } }
I20260812 20:58:31.528939 21415 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:31.528946 21426 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 20:58:31.534113 21450 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 20:58:31.534338 21450 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 20:58:31.536718 21305 master_runner.cc:428] Detected that this master dc14b6da438746ab92e13d40d0479208 is joining an existing cluster
I20260812 20:58:31.536825 21305 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.30.125:44391
I20260812 20:58:31.545939 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.538347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39900 (local address 127.10.30.126:44261)
0812 20:58:31.538414 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.538417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.538626 (+ 209us) server_negotiation.cc:407] Connection header received
0812 20:58:31.538740 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.538742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.538754 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.538806 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.539357 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.539916 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.540744 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.540967 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.541060 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.542450 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.542452 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.542452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.542461 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.544420 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.545004 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.545006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.545006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.545087 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.545323 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.545324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.545324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.545481 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.545555 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.545743 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.545837 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 20:58:31.545939 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.538437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60930 (local address 127.10.30.125:44391)
0812 20:58:31.538485 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.538487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.538548 (+ 61us) server_negotiation.cc:407] Connection header received
0812 20:58:31.538630 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.538631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.538642 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.538711 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.539364 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.540142 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.541187 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.541485 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.541527 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.542700 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.542702 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.542702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.542710 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.544594 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.544976 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.544977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.544978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.545049 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.545261 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.545262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.545263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.545417 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.545484 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.545652 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.545778 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":25}
I20260812 20:58:31.546033 21458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.538330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:39900)
0812 20:58:31.538560 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.538570 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.538649 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.538835 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.538836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.539137 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.539267 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.539285 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.540007 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.540008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.540649 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.540651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.541068 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.541070 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.541137 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.541739 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.541744 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.542336 (+ 592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.544526 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.544527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.544528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.544817 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.545169 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.545170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.545170 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.545248 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.545562 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.545563 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.545627 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.545699 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.545852 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":25,"thread_start_us":152,"threads_started":1}
I20260812 20:58:31.546635 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.538186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.0.0.1:60930)
0812 20:58:31.538476 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.538490 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.538568 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.538760 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.538761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.539129 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.539271 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.539274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.540234 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.540235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.541093 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.541096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.541607 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.541607 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.541672 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.542111 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.542117 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.542606 (+ 489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.544671 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.544672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.544672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.544918 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.545126 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.545126 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.545127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.545190 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.545507 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.545508 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.545563 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.545628 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.546559 (+ 931us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":825,"thread_start_us":94,"threads_started":1}
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.126@KRBTEST.COM for oryx/127.10.30.125@KRBTEST.COM
I20260812 20:58:31.558986 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.549942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60944 (local address 127.10.30.125:44391)
0812 20:58:31.549997 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.550000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.550212 (+ 212us) server_negotiation.cc:407] Connection header received
0812 20:58:31.550285 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.550286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.550297 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.550365 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.550897 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.551721 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.552604 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.552925 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.553000 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.555671 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.555673 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.555674 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.555684 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.557512 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.557931 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.557933 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.557933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.558010 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.558270 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.558271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.558271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.558438 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.558518 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.558761 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.558861 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 20:58:31.558979 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.549861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.0.0.1:60944)
0812 20:58:31.550031 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.550131 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.550215 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.550376 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.550382 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.550735 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.550810 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.550812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.551824 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.551825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.552503 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.552505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.553015 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.553016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.553110 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.553666 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.553671 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.555572 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.557600 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.557608 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.557611 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.557851 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.558110 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.558111 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.558111 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.558191 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.558542 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.558550 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.558620 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.558710 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.558854 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
I20260812 20:58:31.559803 20493 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.30.125:44391: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "dc14b6da438746ab92e13d40d0479208"
member_type: NON_VOTER
last_known_addr {
host: "127.10.30.125"
port: 44391
}
attrs {
promote: true
}
}
dest_uuid: "c6df37556d084a8c8aaefdba5d775475"
cas_config_opid_index: -1
I20260812 20:58:31.560312 20493 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } }
I20260812 20:58:31.561009 21462 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER dc14b6da438746ab92e13d40d0479208 (127.10.30.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } }
I20260812 20:58:31.561414 21372 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:31.562235 21462 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.30.125:44391
I20260812 20:58:31.562350 21461 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } }
I20260812 20:58:31.562459 21461 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:31.562577 21372 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Refusing update from remote peer c6df37556d084a8c8aaefdba5d775475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 20:58:31.562991 21461 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:31.563323 21305 master.cc:537] Master@127.10.30.125:44391 shutting down...
W20260812 20:58:31.564548 20463 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 20:58:31.565060 20463 consensus_peers.cc:487] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 -> Peer dc14b6da438746ab92e13d40d0479208 (127.10.30.125:44391): Couldn't send request to peer dc14b6da438746ab92e13d40d0479208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 20:58:31.566736 21305 raft_consensus.cc:2229] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:31.566852 21305 raft_consensus.cc:2258] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:31.566917 21305 tablet_replica.cc:330] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: stopping tablet replica
W20260812 20:58:31.568248 21333 connection.cc:441] server connection from 127.0.0.1:60906 torn down before Call kudu.master.MasterService.ListTables from 127.0.0.1:60906 (request call id 20) could send its response
I20260812 20:58:31.581341 21305 master.cc:552] Master@127.10.30.125:44391 shutdown complete.
I20260812 20:58:31.581413 21305 master_runner.cc:305] Clearing existing system tablet
I20260812 20:58:31.581588 21305 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:31.581643 21305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:31.582543 21305 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 20:58:31.583271 21468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.583424 21305 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:31.583492 21305 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:31.583575 21305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
uuid: "dc14b6da438746ab92e13d40d0479208"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "61f15c1b1cebbd9e5e592ccc8750db59"
server_key_iv: "b808b64efabb0d2f8f9d65289040ac8c"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.584532 21305 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:31.586382 21305 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 20:58:31.586467 21305 log.cc:1196] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 20:58:31.586724 21305 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Deleting consensus metadata
I20260812 20:58:31.586932 21305 master_runner.cc:315] Copying system tablet from 127.10.30.126:44261
I20260812 20:58:31.587828 21305 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: tablet copy: Beginning tablet copy session from remote peer at address 127.10.30.126:44261
I20260812 20:58:31.595933 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.588439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39902 (local address 127.10.30.126:44261)
0812 20:58:31.588527 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.588530 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.588662 (+ 132us) server_negotiation.cc:407] Connection header received
0812 20:58:31.588740 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.588741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.588754 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.588810 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.589355 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.589961 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.591224 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.591468 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.591527 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.592875 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.592877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.592877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.592886 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.594504 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.594973 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.594975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.594975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.595114 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.595344 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.595345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.595345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.595482 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.595542 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.595714 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.595795 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 20:58:31.595973 21477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.588384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:39902)
0812 20:58:31.588556 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.588571 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.588665 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.588836 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.588838 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.589131 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.589225 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.589228 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.590117 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.590118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.591088 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.591093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.591545 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.591546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.591625 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.592233 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.592240 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.592770 (+ 530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.594602 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.594603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.594604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.594860 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.595190 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.595191 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.595192 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.595273 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.595551 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.595553 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.595613 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.595694 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.595832 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
I20260812 20:58:31.596904 20534 tablet_copy_service.cc:140] P c6df37556d084a8c8aaefdba5d775475: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer dc14b6da438746ab92e13d40d0479208 ({username='oryx', principal='oryx/127.10.30.125@KRBTEST.COM'} at 127.0.0.1:39902)
I20260812 20:58:31.597075 20534 tablet_copy_service.cc:161] P c6df37556d084a8c8aaefdba5d775475: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer dc14b6da438746ab92e13d40d0479208 at {username='oryx', principal='oryx/127.10.30.125@KRBTEST.COM'} at 127.0.0.1:39902: session id = dc14b6da438746ab92e13d40d0479208-00000000000000000000000000000000
I20260812 20:58:31.598033 20534 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 20:58:31.598928 21305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 20:58:31.600440 21305 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: tablet copy: Starting download of 0 data blocks...
I20260812 20:58:31.600630 21305 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: tablet copy: Starting download of 1 WAL segments...
I20260812 20:58:31.601831 21305 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 20:58:31.602907 20534 tablet_copy_service.cc:342] P c6df37556d084a8c8aaefdba5d775475: Request end of tablet copy session dc14b6da438746ab92e13d40d0479208-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.30.125@KRBTEST.COM'} at 127.0.0.1:39902
I20260812 20:58:31.602967 20534 tablet_copy_service.cc:433] P c6df37556d084a8c8aaefdba5d775475: ending tablet copy session dc14b6da438746ab92e13d40d0479208-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer dc14b6da438746ab92e13d40d0479208
I20260812 20:58:31.606283 21305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:31.607666 21480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.607674 21482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.608206 21487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:31.608341 21305 server_base.cc:1034] running on GCE node
I20260812 20:58:31.608489 21305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:31.608709 21305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:31.609849 21305 hybrid_clock.cc:648] HybridClock initialized: now 1786568311609830 us; error 37 us; skew 500 ppm
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:31.611622 21305 init.cc:377] Logged in from keytab as oryx/127.10.30.125@KRBTEST.COM (short username oryx)
I20260812 20:58:31.611984 21305 webserver.cc:460] Webserver started at http://127.10.30.125:34161/ using document root <none> and password file <none>
I20260812 20:58:31.612115 21305 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:31.612149 21305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:31.613224 21305 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:31.613994 21499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.614194 21305 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:31.614259 21305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
uuid: "dc14b6da438746ab92e13d40d0479208"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "61f15c1b1cebbd9e5e592ccc8750db59"
server_key_iv: "b808b64efabb0d2f8f9d65289040ac8c"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.614337 21305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:31.649924 21305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:31.652777 21305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:31.657011 21305 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.125:44391
I20260812 20:58:31.657058 21585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.125:44391 every 8 connection(s)
I20260812 20:58:31.657486 21305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
I20260812 20:58:31.658450 21586 sys_catalog.cc:263] Verifying existing consensus state
I20260812 20:58:31.659125 21586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Bootstrap starting.
I20260812 20:58:31.662158 21586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 20:58:31.662444 21586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: Bootstrap complete.
I20260812 20:58:31.662707 21586 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } }
I20260812 20:58:31.662820 21586 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: dc14b6da438746ab92e13d40d0479208, State: Initialized, Role: LEARNER
I20260812 20:58:31.662880 21586 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } }
I20260812 20:58:31.663204 21586 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:31.663151 21589 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } }
I20260812 20:58:31.663268 21589 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: This master's current role is: LEARNER
I20260812 20:58:31.665096 21604 catalog_manager.cc:1259] Loaded cluster ID: f5f32186dfdf4236b7521f088a015316
I20260812 20:58:31.666201 21604 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: loading cluster ID for follower catalog manager: success
I20260812 20:58:31.667464 21604 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: acquiring CA information for follower catalog manager: success
I20260812 20:58:31.667826 21604 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 20:58:31.678238 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.670006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60970 (local address 127.10.30.125:44391)
0812 20:58:31.670156 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.670163 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.670173 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:31.670204 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.670204 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.670216 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.670296 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.671257 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.672033 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.673170 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.673389 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.673455 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.675191 (+ 1736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.675193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.675194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.675201 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.676910 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.677337 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.677338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.677339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.677402 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.677645 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.677646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.677646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.677771 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.677859 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.678021 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.678097 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
WARNING: no policy specified for oryx/127.10.30.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.124.keytab.
Entry for principal oryx/127.10.30.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.124.keytab.
I20260812 20:58:31.720589 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.124:39493
--webserver_interface=127.10.30.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.124.keytab
--principal=oryx/127.10.30.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:44261,127.10.30.125:44391,127.10.30.124:39493
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:31.828603 21613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:31.828923 21613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:31.828971 21613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:31.830461 21613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:31.830540 21613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:31.830565 21613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:31.830585 21613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:31.830605 21613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:31.832809 21613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:44261,127.10.30.125:44391,127.10.30.124:39493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.124.keytab
--principal=oryx/127.10.30.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.124:39493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.30.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:31.833190 21613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:31.833529 21613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:31.840803 21625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.840853 21621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:31.840883 21622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:31.840819 21613 server_base.cc:1034] running on GCE node
I20260812 20:58:31.841436 21613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:31.841925 21613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:31.843144 21613 hybrid_clock.cc:648] HybridClock initialized: now 1786568311843144 us; error 50 us; skew 500 ppm
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:31.846467 21613 init.cc:377] Logged in from keytab as oryx/127.10.30.124@KRBTEST.COM (short username oryx)
I20260812 20:58:31.847091 21613 webserver.cc:460] Webserver started at http://127.10.30.124:43599/ using document root <none> and password file <none>
I20260812 20:58:31.847419 21613 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:31.847470 21613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:31.847628 21613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:31.849054 21613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data/instance:
uuid: "a3bffd8fd1a44e889c968cabb0ea6826"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "1d6b92cca772f6c8f58373c03ea0a88e"
server_key_iv: "7e35ff86cf8b1a3130f04ba14595b17e"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.849479 21613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal/instance:
uuid: "a3bffd8fd1a44e889c968cabb0ea6826"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "1d6b92cca772f6c8f58373c03ea0a88e"
server_key_iv: "7e35ff86cf8b1a3130f04ba14595b17e"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.851197 21613 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:31.852159 21635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:31.852365 21613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:31.852483 21613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
uuid: "a3bffd8fd1a44e889c968cabb0ea6826"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "1d6b92cca772f6c8f58373c03ea0a88e"
server_key_iv: "7e35ff86cf8b1a3130f04ba14595b17e"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.852584 21613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:31.867229 21613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:31.870362 21613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:31.870623 21613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:31.876338 21613 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.124:39493
I20260812 20:58:31.876391 21725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.124:39493 every 8 connection(s)
I20260812 20:58:31.877120 21613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
I20260812 20:58:31.878535 21726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:31.879060 20839 heartbeater.cc:503] Master 127.10.30.126:44261 was elected leader, sending a full tablet report...
I20260812 20:58:31.879366 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 21613
I20260812 20:58:31.881001 21726 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.124@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.30.124@KRBTEST.COM
I20260812 20:58:31.890893 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.881955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39910 (local address 127.10.30.126:44261)
0812 20:58:31.882019 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.882022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.882033 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:31.882099 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.882100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.882113 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.882193 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.882757 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.883352 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.884311 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.884528 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.884626 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.887450 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.887454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.887455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.887467 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.889259 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.889760 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.889761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.889762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.889838 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.890120 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.890121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.890122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.890274 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.890358 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.890670 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.890779 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 20:58:31.891358 21732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.881732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:39910)
0812 20:58:31.881899 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.881945 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.882020 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.882229 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.882232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.882537 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.882651 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.882655 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.883459 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.883460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.884206 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.884208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.884663 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.884665 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.884749 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.885526 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.885536 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.887339 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.889368 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.889377 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.889379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.889664 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.889908 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.889909 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.889909 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.890046 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.890346 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.890354 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.890526 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.890650 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.890837 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":102,"threads_started":1}
I20260812 20:58:31.891538 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.880276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41992 (local address 127.10.30.124:39493)
0812 20:58:31.880496 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.880506 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.880536 (+ 30us) server_negotiation.cc:407] Connection header received
0812 20:58:31.881031 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.881039 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.881099 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.881301 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.882213 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.883287 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.884133 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.884488 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.884637 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.887951 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.887961 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.887961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.887970 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.889797 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.890309 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.890313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.890313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.890384 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.890617 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.890618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.890618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.890784 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.891190 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.891248 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.891339 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":99,"threads_started":1}
I20260812 20:58:31.892135 21726 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.124@KRBTEST.COM for oryx/127.10.30.125@KRBTEST.COM
I20260812 20:58:31.899902 21732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.892496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.0.0.1:60978)
0812 20:58:31.892584 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.892600 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.892654 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.892827 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.892828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.892963 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.893028 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.893029 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.893754 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.893755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.894322 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.894324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.894679 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.894680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.894744 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.895226 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.895231 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.896683 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.898459 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.898460 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.898460 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.898721 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.898958 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.898959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.898959 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.899097 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.899486 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.899488 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.899551 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.899638 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.899767 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 20:58:31.899905 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.892625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60978 (local address 127.10.30.125:44391)
0812 20:58:31.892701 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.892704 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.892712 (+ 8us) server_negotiation.cc:407] Connection header received
0812 20:58:31.892743 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.892744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.892759 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.892803 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.893097 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.893663 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.894400 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.894606 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.894659 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.896781 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.896784 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.896784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.896793 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.898376 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.898791 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.898792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.898793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.898855 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.899219 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.899220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.899221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.899400 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.899499 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.899672 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.899809 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 20:58:31.900575 21726 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568311, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.124@KRBTEST.COM for oryx/127.10.30.124@KRBTEST.COM
I20260812 20:58:31.908202 21732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.900927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.0.0.1:42004)
0812 20:58:31.900984 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.901007 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.901053 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.901195 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.901196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.901359 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.901397 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.901399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.902117 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.902118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.902602 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.902603 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.903083 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.903084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.903138 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.903696 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.903700 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.905124 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.906943 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.906944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.906945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.907177 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.907407 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.907407 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.907408 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.907468 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.907745 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.907746 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.907789 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.907948 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.908074 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 20:58:31.908202 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.901012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42004 (local address 127.10.30.124:39493)
0812 20:58:31.901061 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.901063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.901075 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:31.901102 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.901102 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.901114 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.901194 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.901495 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.902013 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.902712 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.902928 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.903079 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.905241 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.905243 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.905244 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.905252 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.906773 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.907255 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.907256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.907256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.907321 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.907540 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.907541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.907541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.907675 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.907757 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.907989 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.908128 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":30}
I20260812 20:58:31.910177 21726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Bootstrap starting.
I20260812 20:58:31.911358 21726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:31.911731 21726 log.cc:824] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:31.913937 21726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: No bootstrap required, opened a new log
I20260812 20:58:31.916116 21726 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } }
I20260812 20:58:31.916301 21726 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:31.916325 21726 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3bffd8fd1a44e889c968cabb0ea6826, State: Initialized, Role: FOLLOWER
I20260812 20:58:31.916518 21726 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } }
I20260812 20:58:31.916955 21736 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } } }
I20260812 20:58:31.917028 21726 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:31.917098 21736 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 20:58:31.919394 21757 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 20:58:31.919472 21757 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 20:58:31.922470 21613 master_runner.cc:428] Detected that this master a3bffd8fd1a44e889c968cabb0ea6826 is joining an existing cluster
I20260812 20:58:31.922556 21613 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.30.124:39493
I20260812 20:58:31.931797 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.923889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60980 (local address 127.10.30.125:44391)
0812 20:58:31.923949 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.923952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.924183 (+ 231us) server_negotiation.cc:407] Connection header received
0812 20:58:31.924312 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.924313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.924328 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.924386 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.925066 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.925887 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.926866 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.927240 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.927316 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.928687 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.928689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.928689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.928697 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.930318 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.930779 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.930780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.930781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.930852 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.931171 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.931172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.931173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.931326 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.931393 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.931617 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.931707 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 20:58:31.931814 21767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.923769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.0.0.1:60980)
0812 20:58:31.924090 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.924106 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.924220 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.924469 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.924471 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.924844 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.924956 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.924959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.925978 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.925978 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.926761 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.926763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.927403 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.927404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.927485 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.928022 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.928028 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.928589 (+ 561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.930415 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.930416 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.930417 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.930675 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.930966 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.930967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.930967 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.931096 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.931405 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.931406 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.931474 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.931555 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.931686 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":4,"thread_start_us":130,"threads_started":1}
I20260812 20:58:31.943559 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 20617
I20260812 20:58:31.959708 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:39575
--local_ip_for_outbound_sockets=127.10.30.65
--tserver_master_addrs=127.10.30.126:44261
--webserver_port=38041
--webserver_interface=127.10.30.65
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab
--principal=oryx/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391,127.10.30.124:39493 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 20:58:31.962244 21769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.924106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:39920)
0812 20:58:31.924515 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.924527 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.924603 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.924744 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.924745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.924959 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.925033 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.925035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.925749 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.925750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.926761 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.926763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.927399 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.927400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.927497 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.956471 (+ 28974us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.956478 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.957158 (+ 680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.960154 (+ 2996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.960155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.960156 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.961088 (+ 932us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.961350 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.961351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.961351 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.961419 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.961781 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.961783 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.961859 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.961930 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.962063 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":4,"thread_start_us":76,"threads_started":1}
I20260812 20:58:31.962445 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.924321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42014 (local address 127.10.30.124:39493)
0812 20:58:31.924364 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.924366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.927209 (+ 2843us) server_negotiation.cc:407] Connection header received
0812 20:58:31.927303 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.927303 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.927313 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.927341 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.955719 (+ 28378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.956573 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.957572 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.957853 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.957900 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.959351 (+ 1451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.959352 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.959352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.959360 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.961349 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.961703 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.961704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.961705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.961768 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.961958 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.961959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.961959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.962075 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.962128 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.962288 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.962371 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 20:58:31.962634 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.924202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39920 (local address 127.10.30.126:44261)
0812 20:58:31.924256 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.924258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.924616 (+ 358us) server_negotiation.cc:407] Connection header received
0812 20:58:31.924655 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.924657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.924671 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.924732 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.925098 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.925658 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.926882 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.927249 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.927316 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.957327 (+ 30011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.957331 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.957331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.957343 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.960045 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.961197 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.961199 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.961200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.961278 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.961504 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.961505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.961506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.961681 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.961752 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.962407 (+ 655us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.962515 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 20:58:31.963387 21768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.924370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.0.0.1:42014)
0812 20:58:31.927139 (+ 2769us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.927151 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.927235 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.927413 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.927414 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.955403 (+ 27989us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.955556 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.955565 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.956692 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.956693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.957482 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.957485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.958037 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.958038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.958113 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.958576 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.958582 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.959254 (+ 672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.961425 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.961426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.961427 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.961627 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.961831 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.961832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.961832 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.961886 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.962157 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.962158 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.962191 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.963177 (+ 986us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.963307 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2749,"thread_start_us":77,"threads_started":1}
Aug 12 20:58:31 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568310, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.126@KRBTEST.COM for oryx/127.10.30.124@KRBTEST.COM
I20260812 20:58:31.972855 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.965455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42016 (local address 127.10.30.124:39493)
0812 20:58:31.965494 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.965496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.965507 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:31.965590 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.965591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.965602 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.965648 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.965989 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.966485 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.967399 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.967598 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.967681 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.969862 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.969864 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.969864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.969872 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:31.971538 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.971950 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.971952 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.971952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.972021 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:31.972246 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:31.972247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:31.972248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:31.972378 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:31.972467 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.972653 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.972744 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 20:58:31.972857 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.965405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.0.0.1:42016)
0812 20:58:31.965467 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.965478 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.965525 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.965662 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.965662 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.965843 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.965902 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.965904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.966582 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.966584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.967291 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.967294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.967679 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.967681 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.967788 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.968266 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.968273 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.969753 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:31.971649 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.971650 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.971651 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.971854 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.972099 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:31.972100 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:31.972100 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:31.972171 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:31.972450 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:31.972451 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:31.972507 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.972610 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.972747 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 20:58:31.973934 20493 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.30.124:39493: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826"
member_type: NON_VOTER
last_known_addr {
host: "127.10.30.124"
port: 39493
}
attrs {
promote: true
}
}
dest_uuid: "c6df37556d084a8c8aaefdba5d775475"
cas_config_opid_index: 5
I20260812 20:58:31.974305 20493 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } }
I20260812 20:58:31.974831 21462 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.975615 21681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:31.976166 21462 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.30.124:39493
I20260812 20:58:31.976250 21462 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.976322 21462 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:31.976919 21681 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Refusing update from remote peer c6df37556d084a8c8aaefdba5d775475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 20:58:31.977226 21613 master.cc:537] Master@127.10.30.124:39493 shutting down...
I20260812 20:58:31.977295 21461 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 20:58:31.978224 20467 consensus_peers.cc:487] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 -> Peer a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124:39493): Couldn't send request to peer a3bffd8fd1a44e889c968cabb0ea6826. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 20:58:31.981653 21613 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:31.981801 21613 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:31.981868 21613 tablet_replica.cc:330] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: stopping tablet replica
I20260812 20:58:31.983742 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.975147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60988 (local address 127.10.30.125:44391)
0812 20:58:31.975203 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.975205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.978765 (+ 3560us) server_negotiation.cc:407] Connection header received
0812 20:58:31.978839 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.978841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.978882 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.978947 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:31.979227 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.980059 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.981787 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.982442 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.982506 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.982593 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:31.983571 (+ 978us) server_negotiation.cc:299] Negotiation successful
0812 20:58:31.983639 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 20:58:31.984366 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.974985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.0.0.1:60988)
0812 20:58:31.978689 (+ 3704us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.978705 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.978774 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.979062 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.979063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.979066 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:31.979129 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.979132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.980174 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.980175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.981624 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.981628 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.983341 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.983342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.983422 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.983469 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 20:58:31.984099 (+ 630us) client_negotiation.cc:240] Negotiation successful
0812 20:58:31.984170 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3676}
I20260812 20:58:31.984910 21546 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 LEARNER]: Refusing update from remote peer c6df37556d084a8c8aaefdba5d775475: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 20:58:31.985165 21461 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 20:58:31.985968 21613 master.cc:552] Master@127.10.30.124:39493 shutdown complete.
I20260812 20:58:31.986014 21613 master_runner.cc:305] Clearing existing system tablet
I20260812 20:58:31.985968 21546 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.986162 21613 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:31.986209 21613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:31.987491 21589 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6df37556d084a8c8aaefdba5d775475. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.987583 21589 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: This master's current role is: LEARNER
I20260812 20:58:31.987622 21589 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: NON_VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: true } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.987658 21589 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: This master's current role is: LEARNER
I20260812 20:58:31.987828 21462 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: attempting to promote NON_VOTER dc14b6da438746ab92e13d40d0479208 to VOTER
I20260812 20:58:31.988111 21462 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } }
I20260812 20:58:31.988369 21613 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:31.988786 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.988642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.0.0.1:42018)
0812 20:58:31.988701 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.988751 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 20:58:31.989116 21546 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 LEARNER]: Refusing update from remote peer c6df37556d084a8c8aaefdba5d775475: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 20:58:31.989377 21461 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 20:58:31.989637 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.989321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.0.0.1:42034)
0812 20:58:31.989570 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.989606 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228}
I20260812 20:58:31.989630 21779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260812 20:58:31.989701 20467 consensus_peers.cc:487] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 -> Peer a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124:39493): Couldn't send request to peer a3bffd8fd1a44e889c968cabb0ea6826. Status: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 20:58:31.989735 21613 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:31.989785 21613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:31.989813 21613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
uuid: "a3bffd8fd1a44e889c968cabb0ea6826"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "1d6b92cca772f6c8f58373c03ea0a88e"
server_key_iv: "7e35ff86cf8b1a3130f04ba14595b17e"
server_key_version: "encryptionkey@0"
I20260812 20:58:31.990540 21461 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, dc14b6da438746ab92e13d40d0479208 (127.10.30.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.990902 21613 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:31.991910 21461 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.992007 21461 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:31.992468 21462 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.992559 21462 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:31.992645 21613 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 20:58:31.992717 21613 log.cc:1196] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 20:58:31.992977 21613 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Deleting consensus metadata
I20260812 20:58:31.993136 21613 master_runner.cc:315] Copying system tablet from 127.10.30.126:44261
I20260812 20:58:31.993046 21546 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, dc14b6da438746ab92e13d40d0479208 (127.10.30.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.993856 21613 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: tablet copy: Beginning tablet copy session from remote peer at address 127.10.30.126:44261
I20260812 20:58:31.994238 21589 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:31.994326 21589 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 20:58:32.001458 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.994316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39932 (local address 127.10.30.126:44261)
0812 20:58:31.994364 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:31.994366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:31.994857 (+ 491us) server_negotiation.cc:407] Connection header received
0812 20:58:31.994941 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:31.994942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:31.994954 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:31.995036 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:31.995414 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.995967 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.996735 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.996961 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.997057 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.998317 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:31.998319 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:31.998319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:31.998328 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.000133 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.000528 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.000529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.000530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.000601 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.000821 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.000822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.000822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.000976 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.001064 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.001235 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.001330 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 20:58:32.001477 21791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:31.994420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:39932)
0812 20:58:31.994769 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:31.994779 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:31.994875 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:31.995035 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:31.995036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:31.995261 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:31.995326 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.995327 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.996064 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.996065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.996647 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:31.996649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:31.997060 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:31.997061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:31.997135 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:31.997735 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:31.997740 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:31.998220 (+ 480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.000232 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.000234 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.000234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.000437 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.000678 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.000679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.000679 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.000754 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.001053 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.001054 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.001112 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.001201 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.001333 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":63,"threads_started":1}
I20260812 20:58:32.002172 20534 tablet_copy_service.cc:140] P c6df37556d084a8c8aaefdba5d775475: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a3bffd8fd1a44e889c968cabb0ea6826 ({username='oryx', principal='oryx/127.10.30.124@KRBTEST.COM'} at 127.0.0.1:39932)
I20260812 20:58:32.002296 20534 tablet_copy_service.cc:161] P c6df37556d084a8c8aaefdba5d775475: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a3bffd8fd1a44e889c968cabb0ea6826 at {username='oryx', principal='oryx/127.10.30.124@KRBTEST.COM'} at 127.0.0.1:39932: session id = a3bffd8fd1a44e889c968cabb0ea6826-00000000000000000000000000000000
I20260812 20:58:32.002908 20534 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 20:58:32.003636 21613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 20:58:32.004843 21613 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: tablet copy: Starting download of 0 data blocks...
I20260812 20:58:32.005046 21613 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: tablet copy: Starting download of 1 WAL segments...
I20260812 20:58:32.005965 21613 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 20:58:32.006886 20534 tablet_copy_service.cc:342] P c6df37556d084a8c8aaefdba5d775475: Request end of tablet copy session a3bffd8fd1a44e889c968cabb0ea6826-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.30.124@KRBTEST.COM'} at 127.0.0.1:39932
I20260812 20:58:32.006978 20534 tablet_copy_service.cc:433] P c6df37556d084a8c8aaefdba5d775475: ending tablet copy session a3bffd8fd1a44e889c968cabb0ea6826-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a3bffd8fd1a44e889c968cabb0ea6826
I20260812 20:58:32.010193 21613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:32.011655 21793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:32.011662 21797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:32.012146 21613 server_base.cc:1034] running on GCE node
W20260812 20:58:32.015924 21795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:32.016132 21613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:32.016363 21613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:32.017500 21613 hybrid_clock.cc:648] HybridClock initialized: now 1786568312017488 us; error 36 us; skew 500 ppm
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:32.019311 21613 init.cc:377] Logged in from keytab as oryx/127.10.30.124@KRBTEST.COM (short username oryx)
I20260812 20:58:32.019695 21613 webserver.cc:460] Webserver started at http://127.10.30.124:43799/ using document root <none> and password file <none>
I20260812 20:58:32.019835 21613 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:32.019889 21613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:32.020618 21613 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260812 20:58:32.021274 21806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.021431 21613 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 20:58:32.021489 21613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
uuid: "a3bffd8fd1a44e889c968cabb0ea6826"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "1d6b92cca772f6c8f58373c03ea0a88e"
server_key_iv: "7e35ff86cf8b1a3130f04ba14595b17e"
server_key_version: "encryptionkey@0"
I20260812 20:58:32.021571 21613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:32.030766 21613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:32.033512 21613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:32.037910 21613 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.124:39493
I20260812 20:58:32.038507 21613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
I20260812 20:58:32.038861 21887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.124:39493 every 8 connection(s)
I20260812 20:58:32.039932 21888 sys_catalog.cc:263] Verifying existing consensus state
I20260812 20:58:32.040620 21888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Bootstrap starting.
I20260812 20:58:32.044445 21888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 20:58:32.044744 21888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Bootstrap complete.
I20260812 20:58:32.045050 21888 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } }
I20260812 20:58:32.045182 21888 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a3bffd8fd1a44e889c968cabb0ea6826, State: Initialized, Role: LEARNER
I20260812 20:58:32.045233 21888 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } }
I20260812 20:58:32.045491 21888 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:32.045502 21893 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:32.045794 21893 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: This master's current role is: LEARNER
I20260812 20:58:32.047591 21911 catalog_manager.cc:1259] Loaded cluster ID: f5f32186dfdf4236b7521f088a015316
I20260812 20:58:32.047703 21911 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: loading cluster ID for follower catalog manager: success
I20260812 20:58:32.049049 21911 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: acquiring CA information for follower catalog manager: success
I20260812 20:58:32.049484 21911 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 20:58:32.079636 21065 heartbeater.cc:503] Master 127.10.30.126:44261 was elected leader, sending a full tablet report...
W20260812 20:58:32.096223 21770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:32.096545 21770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:32.096593 21770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:32.098034 21770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:32.098110 21770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:32.098161 21770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:32.100260 21770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab
--principal=oryx/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:39575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=38041
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391,127.10.30.124:39493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:32.100593 21770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:32.100908 21770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:32.107985 21924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:32.108194 21770 server_base.cc:1034] running on GCE node
W20260812 20:58:32.108361 21936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:32.108012 21929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:32.108646 21770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:32.108997 21770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:32.110201 21770 hybrid_clock.cc:648] HybridClock initialized: now 1786568312110147 us; error 67 us; skew 500 ppm
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:32.113737 21770 init.cc:377] Logged in from keytab as oryx/127.10.30.65@KRBTEST.COM (short username oryx)
I20260812 20:58:32.114547 21770 webserver.cc:460] Webserver started at http://127.10.30.65:38041/ using document root <none> and password file <none>
I20260812 20:58:32.114970 21770 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:32.115149 21770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:32.117473 21770 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:32.118373 21948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.118672 21770 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:32.118793 21770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "75f973af41194e19bc44b5aed71de35b"
format_stamp: "Formatted at 2026-08-12 20:58:30 on dist-test-slave-h3ft"
server_key: "12d456fbe3749160c85503a20c75ddaa"
server_key_iv: "5638b8f8bde111d2d80668883c486d16"
server_key_version: "encryptionkey@0"
I20260812 20:58:32.119388 21770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:32.133576 21770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:32.136716 21770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:32.136890 21770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:32.137220 21770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:32.137689 21770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:32.137771 21770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.137821 21770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:32.137858 21770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.146317 21770 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:39575
I20260812 20:58:32.146394 22119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:39575 every 8 connection(s)
I20260812 20:58:32.146938 21770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:58:32.151116 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 21770
I20260812 20:58:32.151345 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 20846
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.124@KRBTEST.COM
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:32.164004 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.148465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.10.30.65:53171)
0812 20:58:32.148623 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.148634 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.149848 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.150482 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.150483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.150809 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.151197 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.151203 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.152490 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.152491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.153918 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.153921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.154465 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.154466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.154610 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.155326 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.155340 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.159083 (+ 3743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.161866 (+ 2783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.161881 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.161884 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.162280 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.162518 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.162519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.162519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.162676 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.163092 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.163099 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.163329 (+ 230us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.163436 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.163665 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":81,"thread_start_us":79,"threads_started":1}
I20260812 20:58:32.164434 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.148808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:53171 (local address 127.10.30.124:39493)
0812 20:58:32.148938 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.148940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.148949 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:32.150347 (+ 1398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.150349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.150368 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.150446 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.151318 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.152358 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.154014 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.154323 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.154387 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.159253 (+ 4866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.159256 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.159256 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.159268 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.161748 (+ 2480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.162366 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.162367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.162368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.162442 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.162736 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.162737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.162738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.162914 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.163062 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.164175 (+ 1113us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.164297 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":74,"threads_started":1}
I20260812 20:58:32.168954 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.148033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:52153 (local address 127.10.30.126:44261)
0812 20:58:32.148123 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.148126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.148460 (+ 334us) server_negotiation.cc:407] Connection header received
0812 20:58:32.150172 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.150174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.150192 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.150263 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.151468 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.152463 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.154444 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.154899 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.154953 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.159379 (+ 4426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.159382 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.159383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.159396 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.163372 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.167624 (+ 4252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.167627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.167628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.167734 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.168055 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.168056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.168057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.168279 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.168359 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.168636 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.168778 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 20:58:32.169581 22129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.148046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:52153)
0812 20:58:32.148286 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.148343 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.149838 (+ 1495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.150297 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.150299 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.150821 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.151298 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.151302 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.152614 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.152615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.154320 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.154323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.155095 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.155096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.155188 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.155783 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.155790 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.158976 (+ 3186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.167051 (+ 8075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.167053 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.167055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.167463 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.167837 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.167839 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.167839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.167948 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.168418 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.168420 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.168486 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.169173 (+ 687us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.169365 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":58,"thread_start_us":138,"threads_started":1}
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.125@KRBTEST.COM
I20260812 20:58:32.183187 22134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.148048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.10.30.65:45949)
0812 20:58:32.148298 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.148343 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.149833 (+ 1490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.150235 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.150240 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.150809 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.151197 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.151203 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.171457 (+ 20254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.171458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.172820 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.172827 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.173782 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.173783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.173906 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.174807 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.174814 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.176732 (+ 1918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.181575 (+ 4843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.181577 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.181578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.181862 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.182131 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.182132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.182132 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.182225 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.182635 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.182636 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.182705 (+ 69us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.182782 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.182977 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":66,"thread_start_us":138,"threads_started":1}
I20260812 20:58:32.183246 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.148635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:45949 (local address 127.10.30.125:44391)
0812 20:58:32.148716 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.148719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.148733 (+ 14us) server_negotiation.cc:407] Connection header received
0812 20:58:32.149991 (+ 1258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.149993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.150011 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.150049 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.151321 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.152173 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.173058 (+ 20885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.173571 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.173641 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.176872 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.176875 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.176875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.176886 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.181438 (+ 4552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.181974 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.181976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.181977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.182051 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.182304 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.182305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.182306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.182518 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.182585 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.182894 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.183078 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 20:58:32.184315 22124 heartbeater.cc:347] Connected to a master server at 127.10.30.125:44391
I20260812 20:58:32.184510 22124 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.184904 22124 heartbeater.cc:511] Master 127.10.30.125:44391 requested a full tablet report, sending...
I20260812 20:58:32.185810 21527 ts_manager.cc:194] Registered new tserver with Master: 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575)
I20260812 20:58:32.187754 22120 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44261
I20260812 20:58:32.187824 22120 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.187899 22122 heartbeater.cc:347] Connected to a master server at 127.10.30.124:39493
I20260812 20:58:32.187925 22120 heartbeater.cc:511] Master 127.10.30.126:44261 requested a full tablet report, sending...
I20260812 20:58:32.187995 22122 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.188094 22122 heartbeater.cc:511] Master 127.10.30.124:39493 requested a full tablet report, sending...
I20260812 20:58:32.188288 20493 ts_manager.cc:194] Re-registered known tserver with Master: 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575)
I20260812 20:58:32.188637 21830 ts_manager.cc:194] Registered new tserver with Master: 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575)
I20260812 20:58:32.188822 20493 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:52153
I20260812 20:58:32.196942 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:35553
--local_ip_for_outbound_sockets=127.10.30.66
--tserver_master_addrs=127.10.30.126:44261
--webserver_port=36031
--webserver_interface=127.10.30.66
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab
--principal=oryx/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391,127.10.30.124:39493 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 20:58:32.296617 21298 heartbeater.cc:503] Master 127.10.30.126:44261 was elected leader, sending a full tablet report...
W20260812 20:58:32.303825 22141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:32.304085 22141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:32.304116 22141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:32.305490 22141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:32.305548 22141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:32.305579 22141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:32.307387 22141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab
--principal=oryx/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:35553
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=36031
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391,127.10.30.124:39493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:32.307724 22141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:32.308028 22141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:32.314388 22155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:32.314360 22156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:32.314360 22159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:32.314620 22141 server_base.cc:1034] running on GCE node
I20260812 20:58:32.314899 22141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:32.315268 22141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:32.316435 22141 hybrid_clock.cc:648] HybridClock initialized: now 1786568312316415 us; error 39 us; skew 500 ppm
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:32.319713 22141 init.cc:377] Logged in from keytab as oryx/127.10.30.66@KRBTEST.COM (short username oryx)
I20260812 20:58:32.320247 22141 webserver.cc:460] Webserver started at http://127.10.30.66:36031/ using document root <none> and password file <none>
I20260812 20:58:32.320542 22141 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:32.320614 22141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:32.322294 22141 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:32.323127 22172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.323359 22141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:32.323480 22141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "70d6e3db3fe3e8c698ab9a7b3713c81a"
server_key_iv: "fb1fca6bbcae5504dad5b93f6fe9d635"
server_key_version: "encryptionkey@0"
I20260812 20:58:32.323980 22141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:32.339066 22141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:32.342190 22141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:32.342434 22141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:32.342772 22141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:32.343273 22141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:32.343338 22141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.343389 22141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:32.343417 22141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.351824 22141 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:35553
I20260812 20:58:32.351876 22362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:35553 every 8 connection(s)
I20260812 20:58:32.352337 22141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:32.355399 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 22141
I20260812 20:58:32.355611 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 21076
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.124@KRBTEST.COM
I20260812 20:58:32.369397 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.353912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:45359 (local address 127.10.30.124:39493)
0812 20:58:32.353971 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.353973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.354091 (+ 118us) server_negotiation.cc:407] Connection header received
0812 20:58:32.355042 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.355043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.355064 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.355100 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.356308 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.357455 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.358947 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.359441 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.359532 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.363806 (+ 4274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.363809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.363810 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.363845 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.366420 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.367578 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.367581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.367581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.367678 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.368150 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.368152 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.368152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.368370 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.368434 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.369049 (+ 615us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.369216 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 20:58:32.370409 22374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.353646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.10.30.66:45359)
0812 20:58:32.354005 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.354015 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.354877 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.355282 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.355288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.355859 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.356190 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.356195 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.357581 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.357582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.358832 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.358834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.359640 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.359641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.359868 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.360721 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.360735 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.363633 (+ 2898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.366778 (+ 3145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.366797 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.366803 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.367447 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.367780 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.367781 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.367782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.368048 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.368496 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.368508 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.368808 (+ 300us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.369618 (+ 810us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.369953 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":83,"threads_started":1}
I20260812 20:58:32.377712 22366 heartbeater.cc:347] Connected to a master server at 127.10.30.124:39493
I20260812 20:58:32.377916 22366 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.378217 22366 heartbeater.cc:511] Master 127.10.30.124:39493 requested a full tablet report, sending...
I20260812 20:58:32.378961 21830 ts_manager.cc:194] Registered new tserver with Master: ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553)
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.125@KRBTEST.COM
I20260812 20:58:32.385751 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:34185
--local_ip_for_outbound_sockets=127.10.30.67
--tserver_master_addrs=127.10.30.126:44261
--webserver_port=43265
--webserver_interface=127.10.30.67
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab
--principal=oryx/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391,127.10.30.124:39493 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 20:58:32.387060 22370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.353286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:33485)
0812 20:58:32.353527 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.353581 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.354876 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.355282 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.355288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.378568 (+ 23280us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.378686 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.378691 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.379717 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.379717 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.380302 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.380304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.380711 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.380712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.380790 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.381455 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.381462 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.383561 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.385632 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.385634 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.385634 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.385886 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.386142 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.386143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.386143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.386205 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.386561 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.386562 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.386641 (+ 79us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.386734 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.386889 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":1,"thread_start_us":156,"threads_started":1}
I20260812 20:58:32.387126 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.353576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:33485 (local address 127.10.30.126:44261)
0812 20:58:32.353666 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.353668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.353679 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:32.355042 (+ 1363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.355044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.355061 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.355100 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.378827 (+ 23727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.379619 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.380416 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.380626 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.380712 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.383678 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.383681 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.383681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.383694 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.385517 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.385993 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.385995 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.385995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.386063 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.386265 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.386266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.386266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.386458 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.386531 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.386779 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.386938 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:32.387516 22364 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44261
I20260812 20:58:32.387573 22364 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.387683 22364 heartbeater.cc:511] Master 127.10.30.126:44261 requested a full tablet report, sending...
I20260812 20:58:32.388037 20493 ts_manager.cc:194] Re-registered known tserver with Master: ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553)
I20260812 20:58:32.388572 20493 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:33485
I20260812 20:58:32.388744 22375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.353286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.10.30.66:34429)
0812 20:58:32.353820 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.353832 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.354876 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.355283 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.355288 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.377682 (+ 22394us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.377804 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.377811 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.378989 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.378991 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.380023 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.380027 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.380642 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.380643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.380720 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.381528 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.381534 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.383641 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.385902 (+ 2261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.385903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.385903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.386129 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.386385 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.386385 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.386386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.386443 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.388350 (+ 1907us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.388351 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.388401 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.388479 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.388611 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":39,"thread_start_us":117,"threads_started":1}
I20260812 20:58:32.388821 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.353280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:34429 (local address 127.10.30.125:44391)
0812 20:58:32.353373 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.353377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.353908 (+ 531us) server_negotiation.cc:407] Connection header received
0812 20:58:32.355073 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.355074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.355098 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.355171 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.377977 (+ 22806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.378857 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.380142 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.380483 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.380531 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.383769 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.383772 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.383772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.383783 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.385799 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.386228 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.386230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.386230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.386306 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.388051 (+ 1745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.388052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.388053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.388260 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.388347 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.388537 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.388684 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 20:58:32.389228 22367 heartbeater.cc:347] Connected to a master server at 127.10.30.125:44391
I20260812 20:58:32.389285 22367 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.389356 22367 heartbeater.cc:511] Master 127.10.30.125:44391 requested a full tablet report, sending...
I20260812 20:58:32.389878 21527 ts_manager.cc:194] Registered new tserver with Master: ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553)
W20260812 20:58:32.492883 22377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:32.493249 22377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:32.493300 22377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:32.495157 22377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:32.495231 22377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:32.495288 22377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:32.497227 22377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab
--principal=oryx/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:34185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=43265
--tserver_master_addrs=127.10.30.126:44261,127.10.30.125:44391,127.10.30.124:39493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:32.497591 22377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:32.497980 22377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 20:58:32.502839 22387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.499000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.0.0.1:42044)
0812 20:58:32.499134 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.499148 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.499245 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.499510 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.499511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.499514 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:32.499601 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.499604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.500487 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.500488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.501376 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.501380 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.502483 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.502485 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.502581 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.502587 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.502651 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.502728 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
I20260812 20:58:32.502810 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.499195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42044 (local address 127.10.30.124:39493)
0812 20:58:32.499283 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.499285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.499298 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:32.499349 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.499350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.499385 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.499471 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:32.499676 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.500396 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.501494 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.502277 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.502379 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.502496 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.502687 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.502739 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 20:58:32.503481 21834 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 20:58:32.503778 21893 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6df37556d084a8c8aaefdba5d775475. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:32.503943 21893 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: This master's current role is: LEARNER
W20260812 20:58:32.505064 22396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:32.505112 22393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:32.505081 22391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:32.505364 22377 server_base.cc:1034] running on GCE node
I20260812 20:58:32.505609 22377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:32.505967 22377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:32.507118 22377 hybrid_clock.cc:648] HybridClock initialized: now 1786568312507083 us; error 40 us; skew 500 ppm
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:32.510412 22377 init.cc:377] Logged in from keytab as oryx/127.10.30.67@KRBTEST.COM (short username oryx)
I20260812 20:58:32.511126 22377 webserver.cc:460] Webserver started at http://127.10.30.67:43265/ using document root <none> and password file <none>
I20260812 20:58:32.511425 22377 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:32.511494 22377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:32.513275 22377 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 20:58:32.514119 22409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.514343 22377 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:32.514494 22377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "d699cc3f6d964d5780d364c1df58e53f"
format_stamp: "Formatted at 2026-08-12 20:58:31 on dist-test-slave-h3ft"
server_key: "6ef15fbbf395f48d10cf3d698ec0d84a"
server_key_iv: "4b5a11b64afe12a5d4642541b9b73107"
server_key_version: "encryptionkey@0"
I20260812 20:58:32.515059 22377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:32.536401 22377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:32.539628 22377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:32.539860 22377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:32.540197 22377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:32.540613 22377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:32.540671 22377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.540716 22377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:32.540759 22377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:32.549386 22377 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:34185
I20260812 20:58:32.549480 22615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:34185 every 8 connection(s)
I20260812 20:58:32.550042 22377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:32.555506 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 22377
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.124@KRBTEST.COM
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.125@KRBTEST.COM
Aug 12 20:58:32 dist-test-slave-h3ft krb5kdc[20416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568312, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:32.564764 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.551869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:57953 (local address 127.10.30.126:44261)
0812 20:58:32.551926 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.551928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.551936 (+ 8us) server_negotiation.cc:407] Connection header received
0812 20:58:32.552414 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.552416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.552432 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.552468 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.553449 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.554282 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.555482 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.555800 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.555844 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.560678 (+ 4834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.560680 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.560681 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.560690 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.562655 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.563397 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.563399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.563399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.563472 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.563816 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.563817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.563818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.563993 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.564060 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.564547 (+ 487us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.564648 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 20:58:32.565433 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.551064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.10.30.67:34327)
0812 20:58:32.551411 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.551462 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.552280 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.552595 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.552600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.553025 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.553314 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.553319 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.554188 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.554189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.555224 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.555227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.555831 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.555832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.555998 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.557098 (+ 1100us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.557103 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.560518 (+ 3415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.562979 (+ 2461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.562980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.562981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.564016 (+ 1035us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.564281 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.564281 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.564282 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.564342 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.564695 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.564696 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.564741 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.564807 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.565085 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":19,"spinlock_wait_cycles":384,"thread_start_us":208,"threads_started":1}
I20260812 20:58:32.565433 22632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.551603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:57953)
0812 20:58:32.551809 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.551819 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.552293 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.552595 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.552600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.553188 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.553315 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.553321 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.554390 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.554391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.555374 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.555375 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.555948 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.555950 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.556016 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.556910 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.556923 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.560558 (+ 3635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.562774 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.562788 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.562792 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.563281 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.563572 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.563573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.563573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.563731 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.564147 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.564155 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.564366 (+ 211us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.564926 (+ 560us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.565143 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":145,"thread_start_us":126,"threads_started":1}
I20260812 20:58:32.566308 22619 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44261
I20260812 20:58:32.566553 22648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.557133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42056 (local address 127.10.30.124:39493)
0812 20:58:32.557436 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.557438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.557647 (+ 209us) server_negotiation.cc:407] Connection header received
0812 20:58:32.557672 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.557673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.557689 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.557752 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.558651 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.559524 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.560650 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.560971 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.561043 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.562478 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.562480 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.562480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.562487 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.564655 (+ 2168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.565404 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.565405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.565406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.565477 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.565715 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.565716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.565716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.565876 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.565992 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.566316 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.566409 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":66,"threads_started":1}
I20260812 20:58:32.566445 22619 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.567076 22619 heartbeater.cc:511] Master 127.10.30.126:44261 requested a full tablet report, sending...
I20260812 20:58:32.567396 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.551055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:34327 (local address 127.10.30.125:44391)
0812 20:58:32.551128 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.551131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.551625 (+ 494us) server_negotiation.cc:407] Connection header received
0812 20:58:32.552398 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.552401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.552419 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.552478 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.553427 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.554056 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.555355 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.555656 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.555709 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.560632 (+ 4923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.560634 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.560634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.560644 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.562867 (+ 2223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.564107 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.564109 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.564110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.564185 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.564445 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.564446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.564447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.564606 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.564668 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.567135 (+ 2467us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.567252 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 20:58:32.567737 20493 ts_manager.cc:194] Re-registered known tserver with Master: d699cc3f6d964d5780d364c1df58e53f (127.10.30.67:34185)
I20260812 20:58:32.568228 20493 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:57953
I20260812 20:58:32.568292 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.551064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.10.30.67:58099)
0812 20:58:32.551426 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.551462 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.552280 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.552595 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.552600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.553038 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:32.553315 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.553342 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.554390 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.554391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.555371 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.555374 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.556098 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.556100 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.556181 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.557020 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:32.557026 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:32.559459 (+ 2433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:32.566662 (+ 7203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.566663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.566663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.567037 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.567271 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:32.567272 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:32.567273 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:32.567331 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:32.567654 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:32.567655 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:32.567701 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.567766 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.567917 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":33,"thread_start_us":250,"threads_started":1}
I20260812 20:58:32.568496 22623 heartbeater.cc:347] Connected to a master server at 127.10.30.125:44391
I20260812 20:58:32.568569 22623 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.568656 22623 heartbeater.cc:511] Master 127.10.30.125:44391 requested a full tablet report, sending...
I20260812 20:58:32.568651 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.551104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:58099 (local address 127.10.30.124:39493)
0812 20:58:32.551219 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.551221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.551592 (+ 371us) server_negotiation.cc:407] Connection header received
0812 20:58:32.552427 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.552429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.552450 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.552486 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.553460 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.554282 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.555482 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.555803 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.555844 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.559578 (+ 3734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.559580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.559580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.559590 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.566565 (+ 6975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.567128 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.567130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.567130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.567196 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.567397 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.567397 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.567398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.567564 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.567626 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.568447 (+ 821us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.568540 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 20:58:32.569005 21527 ts_manager.cc:194] Registered new tserver with Master: d699cc3f6d964d5780d364c1df58e53f (127.10.30.67:34185)
I20260812 20:58:32.569854 22620 heartbeater.cc:347] Connected to a master server at 127.10.30.124:39493
I20260812 20:58:32.569902 22620 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:32.569998 22620 heartbeater.cc:511] Master 127.10.30.124:39493 requested a full tablet report, sending...
I20260812 20:58:32.570364 21830 ts_manager.cc:194] Registered new tserver with Master: d699cc3f6d964d5780d364c1df58e53f (127.10.30.67:34185)
I20260812 20:58:32.572597 22644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.556846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39940 (local address 127.10.30.126:44261)
0812 20:58:32.557388 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.557390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.557534 (+ 144us) server_negotiation.cc:407] Connection header received
0812 20:58:32.561040 (+ 3506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.561041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.561061 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.561127 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.561996 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.562841 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.563995 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.564345 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.564395 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.566208 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.566209 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.566209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.566217 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.571236 (+ 5019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.571630 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.571631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.571632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.571704 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.571927 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.571928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.571928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.572066 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.572187 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.572294 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.572439 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":85,"threads_started":1}
I20260812 20:58:32.574645 22651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.557943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60994 (local address 127.10.30.125:44391)
0812 20:58:32.564797 (+ 6854us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.564799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.565231 (+ 432us) server_negotiation.cc:407] Connection header received
0812 20:58:32.565260 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.565261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.565280 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.565366 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.567168 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.568109 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.569116 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.569405 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.569482 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.570994 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.570996 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.570997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.571054 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.573037 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.573618 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.573620 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.573620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.573710 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.573948 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.573949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.573950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.574126 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.574248 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.574440 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.574542 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6812,"thread_start_us":77,"threads_started":1}
I20260812 20:58:32.574694 20493 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39940:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:32.577040 20493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:32.578227 22658 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: NON_VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: true } } }
I20260812 20:58:32.578357 22658 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:32.580019 22386 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: attempting to promote NON_VOTER a3bffd8fd1a44e889c968cabb0ea6826 to VOTER
I20260812 20:58:32.580185 22386 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } }
I20260812 20:58:32.580667 21546 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Refusing update from remote peer c6df37556d084a8c8aaefdba5d775475: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 20:58:32.581073 21832 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 LEARNER]: Refusing update from remote peer c6df37556d084a8c8aaefdba5d775475: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 20:58:32.581439 22658 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 20:58:32.581621 22658 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 20:58:32.582356 22658 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:32.582659 21832 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:32.583720 22386 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:32.583829 22386 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:32.583731 22658 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:32.583789 21546 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:32.583877 22386 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:32.583926 22386 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:32.583881 22658 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:32.584029 21893 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:32.584126 21893 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 20:58:32.584990 22674 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6df37556d084a8c8aaefdba5d775475" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:32.585103 22674 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 20:58:32.591387 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.586474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37984 (local address 127.10.30.67:34185)
0812 20:58:32.586909 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.586917 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.586931 (+ 14us) server_negotiation.cc:407] Connection header received
0812 20:58:32.586994 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.587037 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.587059 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.587161 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:32.587373 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.588583 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.590029 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.590854 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.590956 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.591190 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.591224 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.591281 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":147,"threads_started":1}
I20260812 20:58:32.591338 22387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.586295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:34185 (local address 127.0.0.1:37984)
0812 20:58:32.586383 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.586398 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.586479 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.587159 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.587160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.587161 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:32.587259 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.587263 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.588696 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.588696 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.589913 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.589915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.590962 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.590963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.591100 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.591105 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.591154 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.591233 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":83}
I20260812 20:58:32.591653 22677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.586441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35553 (local address 127.0.0.1:40924)
0812 20:58:32.586651 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.586664 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.586731 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.587696 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.587697 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.587699 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:32.587738 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.587739 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.588946 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.588947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.589699 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.589701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.591173 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.591175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.591255 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.591260 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.591299 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.591349 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":135,"threads_started":1}
I20260812 20:58:32.591789 22683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.586991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40924 (local address 127.10.30.66:35553)
0812 20:58:32.587510 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.587514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.587524 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:32.587569 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.587571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.587587 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.587698 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:32.587788 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.588847 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.589807 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.590923 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.591425 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.591549 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.591590 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.591653 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":128,"threads_started":1}
I20260812 20:58:32.591902 22679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.586698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:39575 (local address 127.0.0.1:46508)
0812 20:58:32.587280 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.587290 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.587350 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.587569 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.587570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.587572 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:32.587637 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.587639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.588659 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.588660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.590333 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.590336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.591622 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.591623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.591685 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.591690 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.591745 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.591795 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":57,"thread_start_us":113,"threads_started":1}
I20260812 20:58:32.592540 22681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.586867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46508 (local address 127.10.30.65:39575)
0812 20:58:32.587125 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.587131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.587346 (+ 215us) server_negotiation.cc:407] Connection header received
0812 20:58:32.587429 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.587431 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.587449 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.587715 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:32.587797 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.588523 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.590468 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.591412 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.591489 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.591579 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.592094 (+ 515us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.592196 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":154,"threads_started":1}
I20260812 20:58:32.592918 22497 tablet_service.cc:1467] Processing CreateTablet for tablet 99b8ad5aa24241d59af14e4b73da5cac (DEFAULT_TABLE table=test-table [id=6cd826f9442c4d4c88950d82001b7a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:32.593256 22256 tablet_service.cc:1467] Processing CreateTablet for tablet 99b8ad5aa24241d59af14e4b73da5cac (DEFAULT_TABLE table=test-table [id=6cd826f9442c4d4c88950d82001b7a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:32.593377 22016 tablet_service.cc:1467] Processing CreateTablet for tablet 99b8ad5aa24241d59af14e4b73da5cac (DEFAULT_TABLE table=test-table [id=6cd826f9442c4d4c88950d82001b7a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:32.593540 22497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99b8ad5aa24241d59af14e4b73da5cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:32.593669 22256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99b8ad5aa24241d59af14e4b73da5cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:32.593823 22016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99b8ad5aa24241d59af14e4b73da5cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:32.597481 22684 tablet_bootstrap.cc:492] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Bootstrap starting.
I20260812 20:58:32.598114 22685 tablet_bootstrap.cc:492] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Bootstrap starting.
I20260812 20:58:32.598513 22684 tablet_bootstrap.cc:654] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:32.598858 22685 tablet_bootstrap.cc:654] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:32.598961 22684 log.cc:824] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:32.599242 22687 tablet_bootstrap.cc:492] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: Bootstrap starting.
I20260812 20:58:32.599304 22685 log.cc:824] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:32.600097 22687 tablet_bootstrap.cc:654] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:32.600138 22684 tablet_bootstrap.cc:492] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: No bootstrap required, opened a new log
I20260812 20:58:32.600180 22685 tablet_bootstrap.cc:492] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: No bootstrap required, opened a new log
I20260812 20:58:32.600207 22684 ts_tablet_manager.cc:1397] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:58:32.600265 22685 ts_tablet_manager.cc:1397] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 20:58:32.600500 22687 log.cc:824] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:32.601512 22687 tablet_bootstrap.cc:492] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: No bootstrap required, opened a new log
I20260812 20:58:32.601598 22687 ts_tablet_manager.cc:1397] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:32.603434 22685 raft_consensus.cc:348] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.603493 22684 raft_consensus.cc:348] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.603672 22684 raft_consensus.cc:374] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:32.603662 22685 raft_consensus.cc:374] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:32.603719 22684 raft_consensus.cc:729] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75f973af41194e19bc44b5aed71de35b, State: Initialized, Role: FOLLOWER
I20260812 20:58:32.603719 22685 raft_consensus.cc:729] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d699cc3f6d964d5780d364c1df58e53f, State: Initialized, Role: FOLLOWER
I20260812 20:58:32.603906 22685 consensus_queue.cc:260] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.603905 22684 consensus_queue.cc:260] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.604300 22684 ts_tablet_manager.cc:1428] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 20:58:32.604300 22685 ts_tablet_manager.cc:1428] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260812 20:58:32.604209 22687 raft_consensus.cc:348] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.604341 22120 heartbeater.cc:503] Master 127.10.30.126:44261 was elected leader, sending a full tablet report...
I20260812 20:58:32.604385 22687 raft_consensus.cc:374] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:32.604423 22687 raft_consensus.cc:729] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea0dc3e510ae4e84a6a86a966e52f1ca, State: Initialized, Role: FOLLOWER
I20260812 20:58:32.604431 22619 heartbeater.cc:503] Master 127.10.30.126:44261 was elected leader, sending a full tablet report...
I20260812 20:58:32.604548 22687 consensus_queue.cc:260] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.604923 22687 ts_tablet_manager.cc:1428] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 20:58:32.605067 22364 heartbeater.cc:503] Master 127.10.30.126:44261 was elected leader, sending a full tablet report...
W20260812 20:58:32.648346 22127 tablet.cc:2369] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:32.773859 22692 raft_consensus.cc:482] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:32.774168 22692 raft_consensus.cc:504] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.774677 22692 leader_election.cc:288] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553), 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575)
I20260812 20:58:32.779042 22632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.775181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:39575 (local address 127.10.30.67:53835)
0812 20:58:32.775226 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.775239 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.775286 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.775428 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.775428 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.775430 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:32.775513 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.775515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.776445 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.776446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.777821 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.777826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.778652 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.778654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.778765 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.778771 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.778839 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.778901 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":42}
I20260812 20:58:32.779047 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.774902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35553 (local address 127.10.30.67:53623)
0812 20:58:32.774990 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:32.775032 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:32.775107 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:32.775272 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:32.775273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:32.775275 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:32.775375 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.775377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.776445 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.776446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.777821 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:32.777826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.778652 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.778654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:32.778778 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.778780 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 20:58:32.778839 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 20:58:32.778901 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":116}
I20260812 20:58:32.779098 22683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.775046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:53623 (local address 127.10.30.66:35553)
0812 20:58:32.775106 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.775109 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.775120 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:32.775186 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.775188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.775201 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.775261 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:32.775496 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.776343 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.777961 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.778537 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.778624 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.778635 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.778896 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.779025 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 20:58:32.779088 22681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.775232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:53835 (local address 127.10.30.65:39575)
0812 20:58:32.775291 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.775294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.775306 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:32.775357 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.775358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.775366 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.775421 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:32.775609 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.776340 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.777941 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.778549 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.778623 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.778635 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.778896 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.778969 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 20:58:32.779521 22290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99b8ad5aa24241d59af14e4b73da5cac" candidate_uuid: "d699cc3f6d964d5780d364c1df58e53f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" is_pre_election: true
I20260812 20:58:32.779584 22053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99b8ad5aa24241d59af14e4b73da5cac" candidate_uuid: "d699cc3f6d964d5780d364c1df58e53f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75f973af41194e19bc44b5aed71de35b" is_pre_election: true
I20260812 20:58:32.779770 22290 raft_consensus.cc:2454] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d699cc3f6d964d5780d364c1df58e53f in term 0.
I20260812 20:58:32.779791 22053 raft_consensus.cc:2454] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d699cc3f6d964d5780d364c1df58e53f in term 0.
I20260812 20:58:32.780092 22412 leader_election.cc:302] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d699cc3f6d964d5780d364c1df58e53f, ea0dc3e510ae4e84a6a86a966e52f1ca; no voters:
I20260812 20:58:32.780264 22692 raft_consensus.cc:2781] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:32.780364 22692 raft_consensus.cc:482] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:32.780404 22692 raft_consensus.cc:3037] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:32.781374 22692 raft_consensus.cc:504] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.781559 22692 leader_election.cc:288] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [CANDIDATE]: Term 1 election: Requested vote from peers ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553), 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575)
I20260812 20:58:32.781798 22053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99b8ad5aa24241d59af14e4b73da5cac" candidate_uuid: "d699cc3f6d964d5780d364c1df58e53f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75f973af41194e19bc44b5aed71de35b"
I20260812 20:58:32.781805 22290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99b8ad5aa24241d59af14e4b73da5cac" candidate_uuid: "d699cc3f6d964d5780d364c1df58e53f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca"
I20260812 20:58:32.781899 22053 raft_consensus.cc:3037] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:32.781900 22290 raft_consensus.cc:3037] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:32.782850 22053 raft_consensus.cc:2454] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d699cc3f6d964d5780d364c1df58e53f in term 1.
I20260812 20:58:32.783160 22412 leader_election.cc:302] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75f973af41194e19bc44b5aed71de35b, d699cc3f6d964d5780d364c1df58e53f; no voters:
I20260812 20:58:32.783273 22692 raft_consensus.cc:2781] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:32.783453 22692 raft_consensus.cc:686] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 1 LEADER]: Becoming Leader. State: Replica: d699cc3f6d964d5780d364c1df58e53f, State: Running, Role: LEADER
I20260812 20:58:32.783620 22290 raft_consensus.cc:2454] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d699cc3f6d964d5780d364c1df58e53f in term 1.
I20260812 20:58:32.783752 22692 consensus_queue.cc:237] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } }
I20260812 20:58:32.784967 20493 catalog_manager.cc:5495] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f reported cstate change: term changed from 0 to 1, leader changed from <none> to d699cc3f6d964d5780d364c1df58e53f (127.10.30.67). New cstate: current_term: 1 leader_uuid: "d699cc3f6d964d5780d364c1df58e53f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } health_report { overall_health: UNKNOWN } } }
W20260812 20:58:32.801668 22625 tablet.cc:2369] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:32.825260 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.822388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37986 (local address 127.10.30.67:34185)
0812 20:58:32.822493 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.822495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.822506 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:32.822571 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.822572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.822597 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.822688 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:32.822897 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.823508 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.824415 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.824636 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.824702 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.824856 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:32.824993 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:32.825075 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.825108 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.825132 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 20:58:32.827906 22290 raft_consensus.cc:1261] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 1 FOLLOWER]: Refusing update from remote peer d699cc3f6d964d5780d364c1df58e53f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:32.827906 22053 raft_consensus.cc:1261] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 1 FOLLOWER]: Refusing update from remote peer d699cc3f6d964d5780d364c1df58e53f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:32.828421 22698 consensus_queue.cc:1035] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:32.828619 22692 consensus_queue.cc:1035] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [LEADER]: Connected to new peer: Peer: permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:32.833690 22709 mvcc.cc:205] Tried to move back new op lower bound from 7317783809338802176 to 7317783809163255808. Current Snapshot: MvccSnapshot[applied={T|T < 7317783809338802176 or (T in {7317783809338802176})}]
I20260812 20:58:32.835428 20491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:32.835579 20491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:32.836599 22710 mvcc.cc:205] Tried to move back new op lower bound from 7317783809338802176 to 7317783809163255808. Current Snapshot: MvccSnapshot[applied={T|T < 7317783809338802176}]
I20260812 20:58:32.837307 20491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6df37556d084a8c8aaefdba5d775475: Sending DeleteTablet for 3 replicas of tablet 99b8ad5aa24241d59af14e4b73da5cac
I20260812 20:58:32.837803 22497 tablet_service.cc:1514] Processing DeleteTablet for tablet 99b8ad5aa24241d59af14e4b73da5cac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:32 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:37984
I20260812 20:58:32.837833 22256 tablet_service.cc:1514] Processing DeleteTablet for tablet 99b8ad5aa24241d59af14e4b73da5cac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:32 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:40924
I20260812 20:58:32.837929 22016 tablet_service.cc:1514] Processing DeleteTablet for tablet 99b8ad5aa24241d59af14e4b73da5cac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:32 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:46508
I20260812 20:58:32.838161 22727 tablet_replica.cc:330] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: stopping tablet replica
I20260812 20:58:32.838291 22727 raft_consensus.cc:2229] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:32.838440 22727 raft_consensus.cc:2258] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:32.839165 22727 ts_tablet_manager.cc:1905] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:32.840086 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 20434
I20260812 20:58:32.841666 22727 ts_tablet_manager.cc:1918] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:32.841773 22727 log.cc:1196] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/99b8ad5aa24241d59af14e4b73da5cac
I20260812 20:58:32.842139 22727 ts_tablet_manager.cc:1939] T 99b8ad5aa24241d59af14e4b73da5cac P 75f973af41194e19bc44b5aed71de35b: Deleting consensus metadata
I20260812 20:58:32.845592 22729 tablet_replica.cc:330] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: stopping tablet replica
I20260812 20:58:32.846133 22729 raft_consensus.cc:2229] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:32.846787 22729 raft_consensus.cc:2258] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:32.849303 22729 ts_tablet_manager.cc:1905] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:32.854135 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.839587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42060 (local address 127.10.30.124:39493)
0812 20:58:32.839648 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.839652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.840218 (+ 566us) server_negotiation.cc:407] Connection header received
0812 20:58:32.840347 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.840348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.840364 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.840398 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.845422 (+ 5024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.846240 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.847428 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.847810 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.847883 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.850006 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.850009 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.850009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.850019 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.852110 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.852655 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.852657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.852657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.852737 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.853023 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.853024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.853024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.853204 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.853303 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.853542 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.853998 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 20:58:32.854347 22729 ts_tablet_manager.cc:1918] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:32.855352 22724 tablet_replica.cc:330] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: stopping tablet replica
I20260812 20:58:32.855552 22724 raft_consensus.cc:2229] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:32.855767 22724 raft_consensus.cc:2258] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:32.859432 22724 ts_tablet_manager.cc:1905] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:32.859776 22729 log.cc:1196] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/99b8ad5aa24241d59af14e4b73da5cac
I20260812 20:58:32.860215 22729 ts_tablet_manager.cc:1939] T 99b8ad5aa24241d59af14e4b73da5cac P ea0dc3e510ae4e84a6a86a966e52f1ca: Deleting consensus metadata
I20260812 20:58:32.862114 22724 ts_tablet_manager.cc:1918] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:32.862226 22724 log.cc:1196] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/99b8ad5aa24241d59af14e4b73da5cac
I20260812 20:58:32.862561 22724 ts_tablet_manager.cc:1939] T 99b8ad5aa24241d59af14e4b73da5cac P d699cc3f6d964d5780d364c1df58e53f: Deleting consensus metadata
W20260812 20:58:32.881979 22175 connection.cc:535] server connection from 127.0.0.1:40924 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 20:58:32.881942 21950 connection.cc:535] server connection from 127.0.0.1:46508 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 20:58:32.882450 22410 connection.cc:535] server connection from 127.0.0.1:37984 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 20:58:32.893380 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.884492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.10.30.124:39493)
0812 20:58:32.884542 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.884545 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.884689 (+ 144us) server_negotiation.cc:407] Connection header received
0812 20:58:32.884797 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.884799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.884814 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.884848 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.885665 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.886257 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.887273 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.887605 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.887678 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.889754 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.889756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.889756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.889765 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.891888 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.892328 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.892329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.892330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.892406 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.892643 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.892644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.892644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.892812 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.892989 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.893160 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.893263 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 20:58:32.893412 22651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:32.884353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32776 (local address 127.10.30.125:44391)
0812 20:58:32.884415 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:32.884418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:32.884546 (+ 128us) server_negotiation.cc:407] Connection header received
0812 20:58:32.884684 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:32.884685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:32.884713 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:32.884784 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:32.885810 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.886646 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.887649 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:32.887876 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:32.887992 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:32.889642 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:32.889643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:32.889644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:32.889653 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:32.891833 (+ 2180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.892381 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.892382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.892382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.892445 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:32.892707 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:32.892708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:32.892708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:32.892859 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:32.892949 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:32.893202 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 20:58:32.893305 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 20:58:33.833935 22739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:33.833493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:48333)
0812 20:58:33.833675 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:33.833807 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":109,"threads_started":1}
W20260812 20:58:33.834487 22364 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:44261 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:33.836419 22740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:33.836073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:58833)
0812 20:58:33.836241 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:33.836348 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260812 20:58:33.836705 22741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:33.836314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:49329)
0812 20:58:33.836459 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:33.836566 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
W20260812 20:58:33.836723 22120 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:44261 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
W20260812 20:58:33.836942 22619 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:44261 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:34.338351 22742 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6df37556d084a8c8aaefdba5d775475)
I20260812 20:58:34.338634 22742 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } }
I20260812 20:58:34.339097 22742 leader_election.cc:288] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261), a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124:39493)
I20260812 20:58:34.339433 22743 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6df37556d084a8c8aaefdba5d775475)
I20260812 20:58:34.339612 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.339318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40398)
0812 20:58:34.339466 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.339557 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260812 20:58:34.339622 22743 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } }
W20260812 20:58:34.339753 21507 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:34.339932 22743 leader_election.cc:288] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261), dc14b6da438746ab92e13d40d0479208 (127.10.30.125:44391)
I20260812 20:58:34.340265 22750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.340043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40406)
0812 20:58:34.340151 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.340211 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":55,"threads_started":1}
W20260812 20:58:34.340523 21814 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:34.340605 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.340498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40414)
0812 20:58:34.340537 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.340566 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 20:58:34.340688 21507 leader_election.cc:334] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261): Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:34.341061 22750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.340902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40430)
0812 20:58:34.340963 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.341015 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 20:58:34.341176 21814 leader_election.cc:334] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261): Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:34.343596 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.339561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39493 (local address 127.0.0.1:42074)
0812 20:58:34.339695 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.339706 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:34.339798 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:34.340281 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:34.340283 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:34.340287 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:34.340374 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:34.340376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:34.341392 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:34.341393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:34.342606 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:34.342610 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:34.343352 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:34.343353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:34.343421 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:34.343427 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 20:58:34.343487 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 20:58:34.343533 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":44,"threads_started":1}
I20260812 20:58:34.343644 22746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.339839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.10.30.124:39493)
0812 20:58:34.340121 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:34.340124 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:34.340134 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:34.340171 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:34.340172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:34.340186 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:34.340268 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:34.340449 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:34.341291 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:34.342688 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:34.343246 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:34.343327 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:34.343343 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:34.343505 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 20:58:34.343557 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":68,"threads_started":1}
I20260812 20:58:34.344105 21832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc14b6da438746ab92e13d40d0479208" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" is_pre_election: true
I20260812 20:58:34.344256 21832 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc14b6da438746ab92e13d40d0479208 in term 1.
I20260812 20:58:34.344280 22753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.340214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32778 (local address 127.10.30.125:44391)
0812 20:58:34.340366 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:34.340368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:34.340584 (+ 216us) server_negotiation.cc:407] Connection header received
0812 20:58:34.340609 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:34.340610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:34.340621 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:34.340697 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:34.341009 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:34.341775 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:34.343145 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:34.343778 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:34.343860 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:34.343871 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:34.344140 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 20:58:34.344188 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":100,"threads_started":1}
I20260812 20:58:34.344269 22752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.340072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44391 (local address 127.0.0.1:32778)
0812 20:58:34.340461 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.340473 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:34.340529 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:34.340747 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:34.340748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:34.340750 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:34.340891 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:34.340894 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:34.341861 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:34.341862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:34.342987 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:34.342990 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:34.343880 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:34.343881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:34.344058 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:34.344064 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 20:58:34.344134 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 20:58:34.344189 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
I20260812 20:58:34.344586 21507 leader_election.cc:302] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3bffd8fd1a44e889c968cabb0ea6826, dc14b6da438746ab92e13d40d0479208; no voters: c6df37556d084a8c8aaefdba5d775475
I20260812 20:58:34.344609 21546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc14b6da438746ab92e13d40d0479208" is_pre_election: true
I20260812 20:58:34.344861 21546 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3bffd8fd1a44e889c968cabb0ea6826 in term 1.
I20260812 20:58:34.344921 22742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 20:58:34.345021 22742 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6df37556d084a8c8aaefdba5d775475)
I20260812 20:58:34.345048 22742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 1 FOLLOWER]: Advancing to term 2
I20260812 20:58:34.346060 22742 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } }
I20260812 20:58:34.346179 22742 leader_election.cc:288] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [CANDIDATE]: Term 2 election: Requested vote from peers c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261), a3bffd8fd1a44e889c968cabb0ea6826 (127.10.30.124:39493)
I20260812 20:58:34.346391 21809 leader_election.cc:302] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3bffd8fd1a44e889c968cabb0ea6826, dc14b6da438746ab92e13d40d0479208; no voters: c6df37556d084a8c8aaefdba5d775475
I20260812 20:58:34.346568 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.346413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40442)
0812 20:58:34.346496 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.346535 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 20:58:34.346568 22743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 20:58:34.346613 22743 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6df37556d084a8c8aaefdba5d775475)
I20260812 20:58:34.346592 21832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc14b6da438746ab92e13d40d0479208" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a3bffd8fd1a44e889c968cabb0ea6826"
I20260812 20:58:34.346650 22743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 1 FOLLOWER]: Advancing to term 2
I20260812 20:58:34.347148 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.347060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40458)
0812 20:58:34.347093 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.347126 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260812 20:58:34.347229 21507 leader_election.cc:334] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261): Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:34.347919 22743 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } }
I20260812 20:58:34.348065 21832 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dc14b6da438746ab92e13d40d0479208 in current term 2: Already voted for candidate a3bffd8fd1a44e889c968cabb0ea6826 in this term.
I20260812 20:58:34.348116 22743 leader_election.cc:288] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 2 election: Requested vote from peers c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261), dc14b6da438746ab92e13d40d0479208 (127.10.30.125:44391)
I20260812 20:58:34.348309 22752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.348203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40464)
0812 20:58:34.348243 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.348280 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 20:58:34.348758 21507 leader_election.cc:302] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc14b6da438746ab92e13d40d0479208; no voters: a3bffd8fd1a44e889c968cabb0ea6826, c6df37556d084a8c8aaefdba5d775475
I20260812 20:58:34.348724 21546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc14b6da438746ab92e13d40d0479208"
I20260812 20:58:34.348894 22752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.348664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40466)
0812 20:58:34.348829 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.348862 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260812 20:58:34.348889 21546 raft_consensus.cc:2379] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3bffd8fd1a44e889c968cabb0ea6826 in current term 2: Already voted for candidate dc14b6da438746ab92e13d40d0479208 in this term.
I20260812 20:58:34.348939 22742 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 20:58:34.348997 21814 leader_election.cc:334] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261): Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:34.349107 21809 leader_election.cc:302] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3bffd8fd1a44e889c968cabb0ea6826; no voters: c6df37556d084a8c8aaefdba5d775475, dc14b6da438746ab92e13d40d0479208
I20260812 20:58:34.349179 22743 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 20:58:34.835427 22756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.835071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:60457)
0812 20:58:34.835254 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.835337 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":106,"threads_started":1}
I20260812 20:58:34.837513 22758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.837169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:36997)
0812 20:58:34.837386 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.837440 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":128,"threads_started":1}
I20260812 20:58:34.837579 22760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:34.837316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:35023)
0812 20:58:34.837488 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:34.837523 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":88,"threads_started":1}
I20260812 20:58:35.836544 22762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:35.836206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:33285)
0812 20:58:35.836405 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:35.836459 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":99,"threads_started":1}
I20260812 20:58:35.838320 22764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:35.838020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:58565)
0812 20:58:35.838177 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:35.838251 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":81,"threads_started":1}
I20260812 20:58:35.838586 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:35.838115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:55907)
0812 20:58:35.838268 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:35.838322 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260812 20:58:36.025375 22767 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:36.025544 22767 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } }
I20260812 20:58:36.025918 22767 leader_election.cc:288] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261), dc14b6da438746ab92e13d40d0479208 (127.10.30.125:44391)
I20260812 20:58:36.026347 21546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc14b6da438746ab92e13d40d0479208" is_pre_election: true
I20260812 20:58:36.026502 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.026156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40736)
0812 20:58:36.026393 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.026443 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":130,"threads_started":1}
I20260812 20:58:36.026537 21546 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3bffd8fd1a44e889c968cabb0ea6826 in term 2.
I20260812 20:58:36.026782 21809 leader_election.cc:302] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3bffd8fd1a44e889c968cabb0ea6826, dc14b6da438746ab92e13d40d0479208; no voters:
I20260812 20:58:36.026921 22767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 20:58:36.027027 22767 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:36.027076 22767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 2 FOLLOWER]: Advancing to term 3
I20260812 20:58:36.027189 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.026989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40748)
0812 20:58:36.027089 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.027150 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260812 20:58:36.027303 21814 leader_election.cc:334] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261): Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:36.028270 22767 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } }
I20260812 20:58:36.028456 22767 leader_election.cc:288] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 3 election: Requested vote from peers c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261), dc14b6da438746ab92e13d40d0479208 (127.10.30.125:44391)
I20260812 20:58:36.028723 21546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc14b6da438746ab92e13d40d0479208"
I20260812 20:58:36.028793 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.028571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40752)
0812 20:58:36.028709 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.028748 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260812 20:58:36.028851 21546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 2 FOLLOWER]: Advancing to term 3
I20260812 20:58:36.029266 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.029165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40754)
0812 20:58:36.029217 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.029242 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 20:58:36.029357 21814 leader_election.cc:334] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261): Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
I20260812 20:58:36.029829 21546 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3bffd8fd1a44e889c968cabb0ea6826 in term 3.
I20260812 20:58:36.030086 21809 leader_election.cc:302] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3bffd8fd1a44e889c968cabb0ea6826, dc14b6da438746ab92e13d40d0479208; no voters: c6df37556d084a8c8aaefdba5d775475
I20260812 20:58:36.030293 22767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 20:58:36.030427 22767 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [term 3 LEADER]: Becoming Leader. State: Replica: a3bffd8fd1a44e889c968cabb0ea6826, State: Running, Role: LEADER
I20260812 20:58:36.030504 22767 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } }
I20260812 20:58:36.030927 22774 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3bffd8fd1a44e889c968cabb0ea6826. Latest consensus state: current_term: 3 leader_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:36.031132 22774 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:36.031414 22778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:36.032058 22778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:36.032145 22778 catalog_manager.cc:1259] Loaded cluster ID: f5f32186dfdf4236b7521f088a015316
I20260812 20:58:36.032163 22778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:36.032356 22778 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:36.032433 22778 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Loaded TSK: 0
I20260812 20:58:36.032542 22778 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 20:58:36.092146 21830 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:36.094472 21830 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:36.096271 21546 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [term 3 FOLLOWER]: Refusing update from remote peer a3bffd8fd1a44e889c968cabb0ea6826: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 20:58:36.096313 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.096131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40780)
0812 20:58:36.096223 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.096271 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 20:58:36.096692 22767 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 20:58:36.096818 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.096680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.0.0.1:40786)
0812 20:58:36.096770 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.096797 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260812 20:58:36.096922 21814 consensus_peers.cc:487] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 -> Peer c6df37556d084a8c8aaefdba5d775475 (127.10.30.126:44261): Couldn't send request to peer c6df37556d084a8c8aaefdba5d775475. Status: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 20:58:36.097690 22783 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3bffd8fd1a44e889c968cabb0ea6826. Latest consensus state: current_term: 3 leader_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:36.097880 22783 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 20:58:36.098793 22781 mvcc.cc:205] Tried to move back new op lower bound from 7317783822727012352 to 7317783822461546496. Current Snapshot: MvccSnapshot[applied={T|T < 7317783822727012352}]
I20260812 20:58:36.098901 22774 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:36.099076 22774 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:36.099496 22784 mvcc.cc:205] Tried to move back new op lower bound from 7317783822727012352 to 7317783822461546496. Current Snapshot: MvccSnapshot[applied={T|T < 7317783822727012352}]
I20260812 20:58:36.099735 22783 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c6df37556d084a8c8aaefdba5d775475" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44261 } } peers { permanent_uuid: "dc14b6da438746ab92e13d40d0479208" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44391 } attrs { promote: false } } peers { permanent_uuid: "a3bffd8fd1a44e889c968cabb0ea6826" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39493 } attrs { promote: false } } }
I20260812 20:58:36.099864 22783 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc14b6da438746ab92e13d40d0479208 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 20:58:36.105599 22804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.101843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35553 (local address 127.0.0.1:40926)
0812 20:58:36.102028 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.102043 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:36.102108 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:36.102364 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:36.102365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:36.102368 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:36.102456 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:36.102458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.103683 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.103684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:36.104635 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:36.104638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.105349 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.105350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:36.105411 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:36.105418 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 20:58:36.105476 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 20:58:36.105525 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":85,"threads_started":1}
I20260812 20:58:36.105664 22805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.101945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40926 (local address 127.10.30.66:35553)
0812 20:58:36.102095 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:36.102097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:36.102116 (+ 19us) server_negotiation.cc:407] Connection header received
0812 20:58:36.102219 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:36.102220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:36.102233 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:36.102340 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:36.102576 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.103507 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.104746 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.105244 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.105325 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:36.105343 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:36.105506 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 20:58:36.105560 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260812 20:58:36.106205 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.101485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:34185 (local address 127.0.0.1:37988)
0812 20:58:36.101562 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.101579 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:36.101657 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:36.102454 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:36.102455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:36.102456 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:36.102496 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:36.102497 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.103610 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.103610 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:36.105019 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:36.105020 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.105889 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.105890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:36.105979 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:36.105985 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 20:58:36.106049 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 20:58:36.106118 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":29}
I20260812 20:58:36.106546 22803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.101639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37988 (local address 127.10.30.67:34185)
0812 20:58:36.102233 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:36.102236 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:36.102246 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:36.102286 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:36.102287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:36.102299 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:36.102564 (+ 265us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:36.102616 (+ 52us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.103508 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.105142 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.105798 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.105879 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:36.105898 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:36.106391 (+ 493us) server_negotiation.cc:299] Negotiation successful
0812 20:58:36.106462 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":85,"threads_started":1}
I20260812 20:58:36.106567 22256 tablet_service.cc:1467] Processing CreateTablet for tablet 792b42a1e29c417797236ca1d9e80d7c (DEFAULT_TABLE table=test-table [id=7543f547f0144b7b8d23983cc8f300f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:36.106775 22256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 792b42a1e29c417797236ca1d9e80d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:36.106879 22497 tablet_service.cc:1467] Processing CreateTablet for tablet 792b42a1e29c417797236ca1d9e80d7c (DEFAULT_TABLE table=test-table [id=7543f547f0144b7b8d23983cc8f300f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:36.107159 22497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 792b42a1e29c417797236ca1d9e80d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:36.108585 22808 tablet_bootstrap.cc:492] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: Bootstrap starting.
I20260812 20:58:36.108974 22809 tablet_bootstrap.cc:492] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: Bootstrap starting.
I20260812 20:58:36.109303 22808 tablet_bootstrap.cc:654] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:36.109333 22800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.101599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:39575 (local address 127.0.0.1:46522)
0812 20:58:36.101833 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.101849 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:36.101906 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:36.102465 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:36.102466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:36.102469 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:36.102571 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:36.102574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.103463 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.103464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:36.105015 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:36.105019 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.108999 (+ 3980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.109001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:36.109098 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:36.109106 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 20:58:36.109143 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 20:58:36.109207 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":38,"thread_start_us":140,"threads_started":1}
I20260812 20:58:36.109581 22809 tablet_bootstrap.cc:654] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:36.109779 22806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.102069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46522 (local address 127.10.30.65:39575)
0812 20:58:36.102270 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:36.102273 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:36.102285 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:36.102319 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:36.102320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:36.102335 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:36.102450 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:36.102656 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.103357 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.105986 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.108866 (+ 2880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.109544 (+ 678us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:36.109573 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:36.109598 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 20:58:36.109669 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":84,"threads_started":1}
I20260812 20:58:36.110085 22016 tablet_service.cc:1467] Processing CreateTablet for tablet 792b42a1e29c417797236ca1d9e80d7c (DEFAULT_TABLE table=test-table [id=7543f547f0144b7b8d23983cc8f300f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:36.110284 22016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 792b42a1e29c417797236ca1d9e80d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:36.110531 22809 tablet_bootstrap.cc:492] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: No bootstrap required, opened a new log
I20260812 20:58:36.110590 22809 ts_tablet_manager.cc:1397] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:36.110790 22809 raft_consensus.cc:348] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.110882 22809 raft_consensus.cc:374] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:36.110896 22809 raft_consensus.cc:729] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d699cc3f6d964d5780d364c1df58e53f, State: Initialized, Role: FOLLOWER
I20260812 20:58:36.110972 22809 consensus_queue.cc:260] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.111258 22809 ts_tablet_manager.cc:1428] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:36.111709 22764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.111508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:44823)
0812 20:58:36.111626 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.111660 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260812 20:58:36.112058 22764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.111962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:54101)
0812 20:58:36.112005 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.112029 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 20:58:36.112278 22620 heartbeater.cc:503] Master 127.10.30.124:39493 was elected leader, sending a full tablet report...
I20260812 20:58:36.112535 22819 tablet_bootstrap.cc:492] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b: Bootstrap starting.
I20260812 20:58:36.113209 22819 tablet_bootstrap.cc:654] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:36.114071 22808 tablet_bootstrap.cc:492] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: No bootstrap required, opened a new log
I20260812 20:58:36.114140 22808 ts_tablet_manager.cc:1397] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260812 20:58:36.114260 22819 tablet_bootstrap.cc:492] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b: No bootstrap required, opened a new log
I20260812 20:58:36.114343 22819 ts_tablet_manager.cc:1397] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:58:36.114352 22808 raft_consensus.cc:348] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.114475 22808 raft_consensus.cc:374] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:36.114502 22808 raft_consensus.cc:729] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea0dc3e510ae4e84a6a86a966e52f1ca, State: Initialized, Role: FOLLOWER
I20260812 20:58:36.114526 22819 raft_consensus.cc:348] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.114583 22808 consensus_queue.cc:260] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.114614 22819 raft_consensus.cc:374] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:36.114646 22819 raft_consensus.cc:729] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75f973af41194e19bc44b5aed71de35b, State: Initialized, Role: FOLLOWER
I20260812 20:58:36.114717 22819 consensus_queue.cc:260] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.114849 22808 ts_tablet_manager.cc:1428] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:36.115121 22819 ts_tablet_manager.cc:1428] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:36.115526 22762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.115088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:40397)
0812 20:58:36.115438 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.115485 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323}
I20260812 20:58:36.115758 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.115455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:43853)
0812 20:58:36.115683 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.115714 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208}
I20260812 20:58:36.115803 22366 heartbeater.cc:503] Master 127.10.30.124:39493 was elected leader, sending a full tablet report...
I20260812 20:58:36.115906 22122 heartbeater.cc:503] Master 127.10.30.124:39493 was elected leader, sending a full tablet report...
I20260812 20:58:36.116264 22762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.116070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:60051)
0812 20:58:36.116187 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.116222 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 20:58:36.116401 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.116162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:36043)
0812 20:58:36.116336 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.116372 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260812 20:58:36.121686 22368 tablet.cc:2369] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:36.407886 22817 raft_consensus.cc:482] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:36.408026 22817 raft_consensus.cc:504] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.408262 22817 leader_election.cc:288] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575), ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553)
I20260812 20:58:36.408728 22290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792b42a1e29c417797236ca1d9e80d7c" candidate_uuid: "d699cc3f6d964d5780d364c1df58e53f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" is_pre_election: true
I20260812 20:58:36.408725 22053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792b42a1e29c417797236ca1d9e80d7c" candidate_uuid: "d699cc3f6d964d5780d364c1df58e53f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75f973af41194e19bc44b5aed71de35b" is_pre_election: true
I20260812 20:58:36.408907 22290 raft_consensus.cc:2454] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d699cc3f6d964d5780d364c1df58e53f in term 0.
I20260812 20:58:36.408939 22053 raft_consensus.cc:2454] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d699cc3f6d964d5780d364c1df58e53f in term 0.
I20260812 20:58:36.409157 22412 leader_election.cc:302] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d699cc3f6d964d5780d364c1df58e53f, ea0dc3e510ae4e84a6a86a966e52f1ca; no voters:
I20260812 20:58:36.409293 22817 raft_consensus.cc:2781] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:36.409345 22817 raft_consensus.cc:482] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:36.409369 22817 raft_consensus.cc:3037] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:36.410387 22817 raft_consensus.cc:504] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.410570 22817 leader_election.cc:288] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [CANDIDATE]: Term 1 election: Requested vote from peers 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575), ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553)
I20260812 20:58:36.410774 22053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792b42a1e29c417797236ca1d9e80d7c" candidate_uuid: "d699cc3f6d964d5780d364c1df58e53f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75f973af41194e19bc44b5aed71de35b"
I20260812 20:58:36.410910 22053 raft_consensus.cc:3037] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:36.410889 22290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792b42a1e29c417797236ca1d9e80d7c" candidate_uuid: "d699cc3f6d964d5780d364c1df58e53f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca"
I20260812 20:58:36.410979 22290 raft_consensus.cc:3037] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:36.411966 22290 raft_consensus.cc:2454] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d699cc3f6d964d5780d364c1df58e53f in term 1.
I20260812 20:58:36.411966 22053 raft_consensus.cc:2454] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d699cc3f6d964d5780d364c1df58e53f in term 1.
I20260812 20:58:36.412248 22412 leader_election.cc:302] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d699cc3f6d964d5780d364c1df58e53f, ea0dc3e510ae4e84a6a86a966e52f1ca; no voters:
I20260812 20:58:36.412431 22817 raft_consensus.cc:2781] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:36.412695 22817 raft_consensus.cc:686] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 1 LEADER]: Becoming Leader. State: Replica: d699cc3f6d964d5780d364c1df58e53f, State: Running, Role: LEADER
I20260812 20:58:36.412765 22817 consensus_queue.cc:237] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } }
I20260812 20:58:36.413267 22764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.413079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:39555)
0812 20:58:36.413160 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.413219 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 20:58:36.413647 21830 catalog_manager.cc:5495] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f reported cstate change: term changed from 0 to 1, leader changed from <none> to d699cc3f6d964d5780d364c1df58e53f (127.10.30.67). New cstate: current_term: 1 leader_uuid: "d699cc3f6d964d5780d364c1df58e53f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d699cc3f6d964d5780d364c1df58e53f" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 34185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:36.464401 22803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.461706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37996 (local address 127.10.30.67:34185)
0812 20:58:36.461785 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:36.461787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:36.461799 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:36.461840 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:36.461841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:36.461853 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:36.461915 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:36.462100 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.462685 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.463599 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:36.463810 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:36.463918 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:36.464076 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:36.464121 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:36.464183 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:36.464247 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 20:58:36.464276 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 20:58:36.465830 22053 raft_consensus.cc:1261] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [term 1 FOLLOWER]: Refusing update from remote peer d699cc3f6d964d5780d364c1df58e53f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:36.465894 22290 raft_consensus.cc:1261] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 1 FOLLOWER]: Refusing update from remote peer d699cc3f6d964d5780d364c1df58e53f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:36.466166 22817 consensus_queue.cc:1035] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [LEADER]: Connected to new peer: Peer: permanent_uuid: "75f973af41194e19bc44b5aed71de35b" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 39575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:36.466295 22825 consensus_queue.cc:1035] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea0dc3e510ae4e84a6a86a966e52f1ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:36.467276 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.466981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:59835)
0812 20:58:36.467190 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.467239 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186}
I20260812 20:58:36.467398 22762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.467275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:57673)
0812 20:58:36.467329 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.467361 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 20:58:36.468397 22764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.468267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:43243)
0812 20:58:36.468317 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.468356 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 20:58:36.469264 22762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.469098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.66:56279)
0812 20:58:36.469201 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.469230 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 20:58:36.469355 22833 mvcc.cc:205] Tried to move back new op lower bound from 7317783824241172480 to 7317783824027435008. Current Snapshot: MvccSnapshot[applied={T|T < 7317783824241172480}]
I20260812 20:58:36.469475 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.469312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.65:45239)
0812 20:58:36.469413 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.469447 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 20:58:36.470052 22764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.468973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44261 (local address 127.10.30.67:42949)
0812 20:58:36.469969 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.470014 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:44261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":975}
I20260812 20:58:36.471331 21830 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:36.471470 21830 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:36.473134 21830 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3bffd8fd1a44e889c968cabb0ea6826: Sending DeleteTablet for 3 replicas of tablet 792b42a1e29c417797236ca1d9e80d7c
I20260812 20:58:36.473529 22497 tablet_service.cc:1514] Processing DeleteTablet for tablet 792b42a1e29c417797236ca1d9e80d7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:36 UTC) from {username='oryx', principal='oryx/127.10.30.124@KRBTEST.COM'} at 127.0.0.1:37988
I20260812 20:58:36.473590 22256 tablet_service.cc:1514] Processing DeleteTablet for tablet 792b42a1e29c417797236ca1d9e80d7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:36 UTC) from {username='oryx', principal='oryx/127.10.30.124@KRBTEST.COM'} at 127.0.0.1:40926
I20260812 20:58:36.473793 22016 tablet_service.cc:1514] Processing DeleteTablet for tablet 792b42a1e29c417797236ca1d9e80d7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:36 UTC) from {username='oryx', principal='oryx/127.10.30.124@KRBTEST.COM'} at 127.0.0.1:46522
I20260812 20:58:36.473809 22852 tablet_replica.cc:330] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: stopping tablet replica
I20260812 20:58:36.473883 22852 raft_consensus.cc:2229] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:36.473958 22852 raft_consensus.cc:2258] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:36.474033 22854 tablet_replica.cc:330] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: stopping tablet replica
I20260812 20:58:36.474118 22854 raft_consensus.cc:2229] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:36.474123 22855 tablet_replica.cc:330] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b: stopping tablet replica
I20260812 20:58:36.474182 22854 raft_consensus.cc:2258] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:36.474179 22855 raft_consensus.cc:2229] T 792b42a1e29c417797236ca1d9e80d7c P 75f973af41194e19bc44b5aed71de35b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:36.474274 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 21770
I20260812 20:58:36.474578 22854 ts_tablet_manager.cc:1905] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:36.477144 22854 ts_tablet_manager.cc:1918] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:36.477221 22854 log.cc:1196] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/792b42a1e29c417797236ca1d9e80d7c
I20260812 20:58:36.477504 22854 ts_tablet_manager.cc:1939] T 792b42a1e29c417797236ca1d9e80d7c P ea0dc3e510ae4e84a6a86a966e52f1ca: Deleting consensus metadata
I20260812 20:58:36.478783 21809 catalog_manager.cc:4841] TS ea0dc3e510ae4e84a6a86a966e52f1ca (127.10.30.66:35553): tablet 792b42a1e29c417797236ca1d9e80d7c (table test-table [id=7543f547f0144b7b8d23983cc8f300f4]) successfully deleted
I20260812 20:58:36.487634 22852 ts_tablet_manager.cc:1905] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:36.490573 22852 ts_tablet_manager.cc:1918] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:36.490669 22852 log.cc:1196] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/792b42a1e29c417797236ca1d9e80d7c
I20260812 20:58:36.491040 22852 ts_tablet_manager.cc:1939] T 792b42a1e29c417797236ca1d9e80d7c P d699cc3f6d964d5780d364c1df58e53f: Deleting consensus metadata
I20260812 20:58:36.492281 21809 catalog_manager.cc:4841] TS d699cc3f6d964d5780d364c1df58e53f (127.10.30.67:34185): tablet 792b42a1e29c417797236ca1d9e80d7c (table test-table [id=7543f547f0144b7b8d23983cc8f300f4]) successfully deleted
I20260812 20:58:36.498795 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 22141
I20260812 20:58:36.498886 22800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.498718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:39575 (local address 127.0.0.1:46526)
0812 20:58:36.498799 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.498837 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:39575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 20:58:36.505534 21809 catalog_manager.cc:4584] TS 75f973af41194e19bc44b5aed71de35b (127.10.30.65:39575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 792b42a1e29c417797236ca1d9e80d7c: Network error: Client connection negotiation failed: client connection to 127.10.30.65:39575: connect: Connection refused (error 111)
I20260812 20:58:36.524339 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 22377
I20260812 20:58:36.557687 22800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.557421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:39575 (local address 127.0.0.1:46530)
0812 20:58:36.557537 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.557605 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:39575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 20:58:36.558205 22800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:36.558104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:39575 (local address 127.0.0.1:46540)
0812 20:58:36.558145 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:36.558174 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:39575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 20:58:36.559504 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 21305
I20260812 20:58:36.577870 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 21613
2026-08-12T20:58:36Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7641 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:36 dist-test-slave-h3ft krb5kdc[22858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:36 dist-test-slave-h3ft krb5kdc[22858](info): set up 2 sockets
Aug 12 20:58:36 dist-test-slave-h3ft krb5kdc[22858](info): commencing operation
krb5kdc: starting...
W20260812 20:58:37.950630 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.332s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:38Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.126.keytab.
Entry for principal oryx/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.126.keytab.
I20260812 20:58:38.107456 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:37525
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.126.keytab
--principal=oryx/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:37525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:38.208369 22885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:38.208695 22885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:38.208736 22885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:38.210021 22885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:38.210107 22885 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 20:58:38.210131 22885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:38.210155 22885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:38.210189 22885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:38.210220 22885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:38.212657 22885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:37525
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.126.keytab
--principal=oryx/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:37525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:38.213275 22885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:38.213855 22885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:38.220366 22895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:38.220371 22898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:38.220641 22885 server_base.cc:1034] running on GCE node
W20260812 20:58:38.220366 22893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:38.221143 22885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:38.221554 22885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:38.222767 22885 hybrid_clock.cc:648] HybridClock initialized: now 1786568318222770 us; error 53 us; skew 500 ppm
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:38.226579 22885 init.cc:377] Logged in from keytab as oryx/127.10.30.126@KRBTEST.COM (short username oryx)
I20260812 20:58:38.227380 22885 webserver.cc:460] Webserver started at http://127.10.30.126:45029/ using document root <none> and password file <none>
I20260812 20:58:38.227736 22885 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:38.227823 22885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:38.228024 22885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:38.229496 22885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "a30e5e2591ce4436bfc545e3867fa4d8"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "6cc9bd8a0b7331e2baec3aad1ce99ff3"
server_key_iv: "47cc7453ef57f3747834346713ea43b2"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.230010 22885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "a30e5e2591ce4436bfc545e3867fa4d8"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "6cc9bd8a0b7331e2baec3aad1ce99ff3"
server_key_iv: "47cc7453ef57f3747834346713ea43b2"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.232296 22885 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:58:38.234031 22912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.234732 22885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:38.235427 22885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "a30e5e2591ce4436bfc545e3867fa4d8"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "6cc9bd8a0b7331e2baec3aad1ce99ff3"
server_key_iv: "47cc7453ef57f3747834346713ea43b2"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.235818 22885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:38.259088 22885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:38.262085 22885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:38.262310 22885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:38.269292 22885 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:37525
I20260812 20:58:38.269330 23026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:37525 every 8 connection(s)
I20260812 20:58:38.269802 22885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:38.270892 23027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:38.273904 23027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: Bootstrap starting.
I20260812 20:58:38.274750 23027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:38.275190 23027 log.cc:824] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:38.276185 23027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: No bootstrap required, opened a new log
I20260812 20:58:38.276271 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 22885
I20260812 20:58:38.276417 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:38.276665 10361 external_mini_cluster.cc:1428] Setting key 46e397a021591bc890c6108736c3b5d9
I20260812 20:58:38.279333 23027 raft_consensus.cc:348] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30e5e2591ce4436bfc545e3867fa4d8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37525 } }
I20260812 20:58:38.279547 23027 raft_consensus.cc:374] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:38.279605 23027 raft_consensus.cc:729] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a30e5e2591ce4436bfc545e3867fa4d8, State: Initialized, Role: FOLLOWER
I20260812 20:58:38.279783 23027 consensus_queue.cc:260] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30e5e2591ce4436bfc545e3867fa4d8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37525 } }
I20260812 20:58:38.279901 23027 raft_consensus.cc:388] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:38.279938 23027 raft_consensus.cc:482] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:38.280000 23027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:38.280933 23027 raft_consensus.cc:504] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30e5e2591ce4436bfc545e3867fa4d8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37525 } }
I20260812 20:58:38.281085 23027 leader_election.cc:302] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a30e5e2591ce4436bfc545e3867fa4d8; no voters:
I20260812 20:58:38.281275 23027 leader_election.cc:288] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:38.281337 23042 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:38.281500 23042 raft_consensus.cc:686] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [term 1 LEADER]: Becoming Leader. State: Replica: a30e5e2591ce4436bfc545e3867fa4d8, State: Running, Role: LEADER
I20260812 20:58:38.281625 23027 sys_catalog.cc:564] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:38.281600 23042 consensus_queue.cc:237] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30e5e2591ce4436bfc545e3867fa4d8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37525 } }
I20260812 20:58:38.282137 23043 sys_catalog.cc:455] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a30e5e2591ce4436bfc545e3867fa4d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30e5e2591ce4436bfc545e3867fa4d8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37525 } } }
I20260812 20:58:38.282153 23046 sys_catalog.cc:455] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a30e5e2591ce4436bfc545e3867fa4d8. Latest consensus state: current_term: 1 leader_uuid: "a30e5e2591ce4436bfc545e3867fa4d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30e5e2591ce4436bfc545e3867fa4d8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37525 } } }
I20260812 20:58:38.282402 23043 sys_catalog.cc:458] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:38.282420 23046 sys_catalog.cc:458] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:38.282860 23059 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:38.283643 23059 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:38.285504 23059 catalog_manager.cc:1347] Generated new cluster ID: 45f4eb26470d41ec8dfcb588ce58183e
I20260812 20:58:38.285565 23059 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:38.291097 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.277559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43338 (local address 127.10.30.126:37525)
0812 20:58:38.277784 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.277793 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.277825 (+ 32us) server_negotiation.cc:407] Connection header received
0812 20:58:38.279315 (+ 1490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.279325 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.279397 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.279559 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.280624 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.282124 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.283391 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.284004 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.284136 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.287174 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:38.287179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:38.287179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:38.287199 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:38.289183 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.289611 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.289615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.289615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.289740 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.290027 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.290028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.290028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.290320 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:38.290537 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.290628 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.290796 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":129,"threads_started":1}
I20260812 20:58:38.299796 23059 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:38.300544 23059 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:38.312350 23059 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: Generated new TSK 0
I20260812 20:58:38.312682 23059 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab.
Entry for principal oryx/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab.
I20260812 20:58:38.356195 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:37525
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab
--principal=oryx/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:38.456930 23088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:38.457211 23088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:38.457242 23088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:38.458570 23088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:38.458614 23088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:38.458637 23088 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:38.458657 23088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:38.460808 23088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab
--principal=oryx/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:37525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:38.461123 23088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:38.461395 23088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 20:58:38.467896 23088 server_base.cc:1034] running on GCE node
W20260812 20:58:38.467873 23107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:38.467872 23100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:38.467873 23099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:38.468559 23088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:38.468956 23088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:38.470417 23088 hybrid_clock.cc:648] HybridClock initialized: now 1786568318470391 us; error 40 us; skew 500 ppm
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:38.474038 23088 init.cc:377] Logged in from keytab as oryx/127.10.30.65@KRBTEST.COM (short username oryx)
I20260812 20:58:38.474681 23088 webserver.cc:460] Webserver started at http://127.10.30.65:45775/ using document root <none> and password file <none>
I20260812 20:58:38.474993 23088 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:38.475111 23088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:38.475281 23088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:38.476596 23088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "b2bfdf251a884d44bd00f67c26c69df1"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "945fd41aeb2b6c68816563cf8a644e5f"
server_key_iv: "725f8ea6740a1fa99d054dd495d7a76a"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.477041 23088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "b2bfdf251a884d44bd00f67c26c69df1"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "945fd41aeb2b6c68816563cf8a644e5f"
server_key_iv: "725f8ea6740a1fa99d054dd495d7a76a"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.478685 23088 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 20:58:38.479700 23117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.479905 23088 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:38.480028 23088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "b2bfdf251a884d44bd00f67c26c69df1"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "945fd41aeb2b6c68816563cf8a644e5f"
server_key_iv: "725f8ea6740a1fa99d054dd495d7a76a"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.480141 23088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:38.492316 23088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:38.495191 23088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:38.495352 23088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:38.495980 23088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:38.496062 23088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.496110 23088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:38.496134 23088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.504534 23088 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:32771
I20260812 20:58:38.504660 23337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:32771 every 8 connection(s)
I20260812 20:58:38.505038 23088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:38.508823 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.496733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:48305 (local address 127.10.30.126:37525)
0812 20:58:38.496820 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.496824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.497053 (+ 229us) server_negotiation.cc:407] Connection header received
0812 20:58:38.497701 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.497703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.497727 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.497817 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.498957 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.500006 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.501884 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.502298 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.502414 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.505789 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:38.505790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:38.505791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:38.505802 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:38.507420 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.507854 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.507855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.507856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.507919 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.508172 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.508173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.508173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.508307 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:38.508367 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.508655 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.508742 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 20:58:38.509003 23131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.496685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:37525 (local address 127.10.30.65:48305)
0812 20:58:38.496881 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.496934 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.497586 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.497923 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.497927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.498437 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:38.498834 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.498842 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.500126 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.500127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.501792 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.501796 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.502427 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.502428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.502610 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.503474 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:38.503496 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:38.505676 (+ 2180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:38.507523 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.507531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.507533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.507784 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.507984 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.507984 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.507985 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.508110 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.508366 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:38.508372 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:38.508510 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.508623 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.508773 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260812 20:58:38.509733 23338 heartbeater.cc:347] Connected to a master server at 127.10.30.126:37525
I20260812 20:58:38.509837 23338 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:38.510113 23338 heartbeater.cc:511] Master 127.10.30.126:37525 requested a full tablet report, sending...
I20260812 20:58:38.510877 22943 ts_manager.cc:194] Registered new tserver with Master: b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771)
I20260812 20:58:38.511919 22943 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:48305
I20260812 20:58:38.514256 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 23088
I20260812 20:58:38.514446 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:38.514724 10361 external_mini_cluster.cc:1428] Setting key be75fe30c1014642ab4f49e5a04e6475
I20260812 20:58:38.517746 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.511111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:48447 (local address 127.10.30.126:37525)
0812 20:58:38.511165 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.511167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.511308 (+ 141us) server_negotiation.cc:407] Connection header received
0812 20:58:38.511336 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.511337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.511350 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.511422 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.511774 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.512535 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.513459 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.513673 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.513738 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.515080 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:38.515082 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:38.515083 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:38.515091 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:38.516498 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.516879 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.516881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.516881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.516951 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.517171 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.517172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.517172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.517301 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:38.517379 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.517552 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.517645 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 20:58:38.517762 23355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.511060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:37525 (local address 127.10.30.65:48447)
0812 20:58:38.511224 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.511240 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.511298 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.511432 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.511433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.511637 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:38.511704 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.511706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.512661 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.512662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.513361 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.513364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.513749 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.513749 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.513804 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.514459 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:38.514465 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:38.514905 (+ 440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:38.516593 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.516595 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.516595 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.516788 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.517030 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.517030 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.517031 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.517101 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.517379 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:38.517380 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:38.517435 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.517522 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.517645 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
WARNING: no policy specified for oryx/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab.
Entry for principal oryx/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab.
I20260812 20:58:38.552639 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:37525
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab
--principal=oryx/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:38.649847 23361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:38.650126 23361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:38.650158 23361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:38.651546 23361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:38.651592 23361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:38.651616 23361 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:38.651635 23361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:38.653429 23361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab
--principal=oryx/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:37525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:38.653759 23361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:38.654038 23361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:38.660061 23376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:38.660079 23371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:38.660176 23372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:38.660503 23361 server_base.cc:1034] running on GCE node
I20260812 20:58:38.660779 23361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:38.661135 23361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:38.662356 23361 hybrid_clock.cc:648] HybridClock initialized: now 1786568318662331 us; error 45 us; skew 500 ppm
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:38.665669 23361 init.cc:377] Logged in from keytab as oryx/127.10.30.66@KRBTEST.COM (short username oryx)
I20260812 20:58:38.666237 23361 webserver.cc:460] Webserver started at http://127.10.30.66:40337/ using document root <none> and password file <none>
I20260812 20:58:38.666520 23361 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:38.666574 23361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:38.666723 23361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:38.668046 23361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "395b85521bb4475c82d7665a33ff811e"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "a384b2462a6f912801d9076424221d22"
server_key_iv: "42e343efcfe0668347bd1bf0587b8190"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.668475 23361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "395b85521bb4475c82d7665a33ff811e"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "a384b2462a6f912801d9076424221d22"
server_key_iv: "42e343efcfe0668347bd1bf0587b8190"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.670200 23361 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 20:58:38.671176 23388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.671411 23361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:38.671527 23361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "395b85521bb4475c82d7665a33ff811e"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "a384b2462a6f912801d9076424221d22"
server_key_iv: "42e343efcfe0668347bd1bf0587b8190"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.671615 23361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:38.688728 23361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:38.691632 23361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:38.691834 23361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:38.692696 23361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:38.692755 23361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.692804 23361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:38.692819 23361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:38.702277 23361 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:36797
I20260812 20:58:38.702497 23591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:36797 every 8 connection(s)
I20260812 20:58:38.702852 23361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:38.705827 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.693266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:60823 (local address 127.10.30.126:37525)
0812 20:58:38.693346 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.693351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.693626 (+ 275us) server_negotiation.cc:407] Connection header received
0812 20:58:38.694293 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.694294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.694320 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.694411 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.695370 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.696300 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.697812 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.698226 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.698331 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.701886 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:38.701888 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:38.701888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:38.701901 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:38.704009 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.704561 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.704563 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.704564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.704648 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.704969 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.704970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.704971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.705146 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:38.705232 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.705595 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.705706 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 20:58:38.706099 23403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.693247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:37525 (local address 127.10.30.66:60823)
0812 20:58:38.693454 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.693503 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.694173 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.694533 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.694538 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.694934 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:38.695267 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.695274 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.696473 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.696475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.697681 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.697686 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.698375 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.698376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.698582 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.699539 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:38.699551 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:38.701745 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:38.704132 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.704142 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.704145 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.704452 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.704731 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.704732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.704733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.704879 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.705232 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:38.705242 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:38.705422 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.705565 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.705793 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":118,"threads_started":1}
I20260812 20:58:38.706740 23595 heartbeater.cc:347] Connected to a master server at 127.10.30.126:37525
I20260812 20:58:38.706846 23595 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:38.707147 23595 heartbeater.cc:511] Master 127.10.30.126:37525 requested a full tablet report, sending...
I20260812 20:58:38.707723 22950 ts_manager.cc:194] Registered new tserver with Master: 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797)
I20260812 20:58:38.708362 22950 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:60823
I20260812 20:58:38.710739 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 23361
I20260812 20:58:38.710887 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:38.711230 10361 external_mini_cluster.cc:1428] Setting key 89ae986c0045bb022bf32d4e0e083708
I20260812 20:58:38.715683 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.708325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:50411 (local address 127.10.30.126:37525)
0812 20:58:38.708372 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.708374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.708534 (+ 160us) server_negotiation.cc:407] Connection header received
0812 20:58:38.708654 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.708655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.708668 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.708734 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.709178 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.709745 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.710745 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.711138 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.711211 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.712688 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:38.712689 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:38.712689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:38.712697 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:38.714275 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.714703 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.714704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.714705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.714773 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.714993 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.714994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.714995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.715216 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:38.715305 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.715476 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.715573 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 20:58:38.715706 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.708232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:37525 (local address 127.10.30.66:50411)
0812 20:58:38.708453 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.708467 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.708564 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.708741 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.708742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.708998 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:38.709090 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.709093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.709912 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.709913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.710621 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.710625 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.711229 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.711230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.711330 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.711981 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:38.711988 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:38.712579 (+ 591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:38.714411 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.714414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.714414 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.714624 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.714852 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.714853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.714854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.714925 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.715296 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:38.715297 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:38.715358 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.715448 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.715591 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":102,"threads_started":1}
WARNING: no policy specified for oryx/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab.
Entry for principal oryx/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab.
I20260812 20:58:38.751178 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:37525
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab
--principal=oryx/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:38.857600 23612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:38.857899 23612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:38.857949 23612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:38.859436 23612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:38.859506 23612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:38.859548 23612 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 20:58:38.859612 23612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:38.861418 23612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab
--principal=oryx/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.30.126:37525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:38.861752 23612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:38.862051 23612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 20:58:38.868541 23612 server_base.cc:1034] running on GCE node
W20260812 20:58:38.868521 23624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:38.868516 23618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:38.868520 23622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:38.869170 23612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:38.869474 23612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:38.870692 23612 hybrid_clock.cc:648] HybridClock initialized: now 1786568318870669 us; error 46 us; skew 500 ppm
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:38.874069 23612 init.cc:377] Logged in from keytab as oryx/127.10.30.67@KRBTEST.COM (short username oryx)
I20260812 20:58:38.874617 23612 webserver.cc:460] Webserver started at http://127.10.30.67:43719/ using document root <none> and password file <none>
I20260812 20:58:38.874899 23612 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:38.874951 23612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:38.875141 23612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:38.876422 23612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "28f973828a74476d883c077bb307b13e"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "6cc4e8357425608c1c38e30dd23bdfc3"
server_key_iv: "d755d4355a4c410528b65aa58f7ce13b"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.876781 23612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "28f973828a74476d883c077bb307b13e"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "6cc4e8357425608c1c38e30dd23bdfc3"
server_key_iv: "d755d4355a4c410528b65aa58f7ce13b"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.878358 23612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:38.879487 23638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.879695 23612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:38.879822 23612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "28f973828a74476d883c077bb307b13e"
format_stamp: "Formatted at 2026-08-12 20:58:38 on dist-test-slave-h3ft"
server_key: "6cc4e8357425608c1c38e30dd23bdfc3"
server_key_iv: "d755d4355a4c410528b65aa58f7ce13b"
server_key_version: "encryptionkey@0"
I20260812 20:58:38.879917 23612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:38.893334 23612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:38.896309 23612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:38.896525 23612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:38.897496 23612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:38.897562 23612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.897612 23612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:38.897660 23612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:38.906330 23612 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:35191
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:38.906558 23860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:35191 every 8 connection(s)
I20260812 20:58:38.906853 23612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:38.909570 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 23612
I20260812 20:58:38.909718 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:38.910008 10361 external_mini_cluster.cc:1428] Setting key 46eec21f5e0f4aa63612c927f811f5e9
I20260812 20:58:38.910847 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.898094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:58373 (local address 127.10.30.126:37525)
0812 20:58:38.898182 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.898186 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.898505 (+ 319us) server_negotiation.cc:407] Connection header received
0812 20:58:38.899349 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.899350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.899368 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.899432 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.900444 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.901366 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.903343 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.903727 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.903805 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.907319 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:38.907322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:38.907322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:38.907333 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:38.908917 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.909442 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.909443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.909444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.909554 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.909938 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.909939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.909939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.910138 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:38.910224 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.910603 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.910722 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 20:58:38.911124 23650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.898068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:37525 (local address 127.10.30.67:58373)
0812 20:58:38.898372 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.898408 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.899159 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.899525 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.899531 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.899979 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:38.900342 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.900349 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.901509 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.901511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.903195 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.903202 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.903877 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.903878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.904039 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.904829 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:38.904843 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:38.907153 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:38.909008 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.909017 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.909020 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.909277 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.909629 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.909630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.909630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.909848 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.910215 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:38.910223 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:38.910408 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.910562 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.910790 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":105,"threads_started":1}
I20260812 20:58:38.911648 23862 heartbeater.cc:347] Connected to a master server at 127.10.30.126:37525
I20260812 20:58:38.911756 23862 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:38.912004 23862 heartbeater.cc:511] Master 127.10.30.126:37525 requested a full tablet report, sending...
I20260812 20:58:38.912474 22950 ts_manager.cc:194] Registered new tserver with Master: 28f973828a74476d883c077bb307b13e (127.10.30.67:35191)
I20260812 20:58:38.912969 22950 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:58373
I20260812 20:58:38.919181 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.913038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:55871 (local address 127.10.30.126:37525)
0812 20:58:38.913094 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.913096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.913321 (+ 225us) server_negotiation.cc:407] Connection header received
0812 20:58:38.913386 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.913387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.913399 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.913483 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.913898 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.914435 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.915345 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.915551 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.915610 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.916592 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:38.916594 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:38.916594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:38.916600 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:38.917996 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.918401 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.918403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.918403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.918467 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.918647 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.918647 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.918647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.918756 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:38.918808 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.918975 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.919111 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 20:58:38.919193 23870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.912925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:37525 (local address 127.10.30.67:55871)
0812 20:58:38.913233 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.913248 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.913322 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.913479 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.913480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.913722 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:38.913815 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.913817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.914578 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.914579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.915267 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.915269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.915624 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.915625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.915681 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.916141 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:38.916147 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:38.916504 (+ 357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:38.918077 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.918078 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.918079 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.918334 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.918527 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:38.918528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:38.918528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:38.918591 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:38.918829 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:38.918830 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:38.918877 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.918940 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.919101 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":158,"threads_started":1}
I20260812 20:58:38.922114 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 20:58:38.951383 23040 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:38.944162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41882 (local address 127.10.30.126:37525)
0812 20:58:38.944243 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.944246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.944257 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:38.944294 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.944294 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.944305 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.944377 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.945088 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.945644 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.946462 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.946672 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.946755 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.951167 (+ 4412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41882: BlockingRecv error: recv got EOF from 127.0.0.1:41882 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 20:58:38 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:38.962399 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.952268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41888 (local address 127.10.30.126:37525)
0812 20:58:38.952330 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.952333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.952527 (+ 194us) server_negotiation.cc:407] Connection header received
0812 20:58:38.952610 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.952611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.952627 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.952700 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:38.953404 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.954211 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.955352 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.955651 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.955694 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.958867 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:38.958869 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:38.958870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:38.958881 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:38.960705 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.961158 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.961160 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.961161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.961227 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:38.961420 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:38.961421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:38.961421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:38.961587 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:38.961681 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.961992 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.962183 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 20:58:38.964789 22950 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:38.966774 22950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:38.975347 23909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.970265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:35191 (local address 127.0.0.1:41922)
0812 20:58:38.970513 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.970570 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.970657 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.971227 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.971230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.971232 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:38.971342 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.971345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.972448 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.972449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.973729 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.973732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.974873 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.974874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.974979 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.975130 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.975182 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.975235 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":156,"threads_started":1}
I20260812 20:58:38.975592 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.970741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54832 (local address 127.10.30.65:32771)
0812 20:58:38.971110 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.971115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.971128 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:38.971177 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.971180 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.971197 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.971282 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:38.971560 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.972807 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.974255 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.974812 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.974921 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.975364 (+ 443us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.975400 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.975453 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":117,"threads_started":1}
I20260812 20:58:38.975708 23911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.970526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:36797 (local address 127.0.0.1:42904)
0812 20:58:38.971342 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.971353 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.971407 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.971687 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.971688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.971690 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:38.971733 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.971735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.972963 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.972964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.974014 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.974017 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.975221 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.975221 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.975275 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.975279 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.975325 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.975362 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"thread_start_us":79,"threads_started":1}
I20260812 20:58:38.975805 23910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.970438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41922 (local address 127.10.30.67:35191)
0812 20:58:38.971040 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.971044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.971056 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:38.971109 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.971112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.971130 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.971220 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:38.971450 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.972351 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.973835 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.974668 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.974743 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.974833 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.975621 (+ 788us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.975675 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":146,"threads_started":1}
I20260812 20:58:38.975975 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.970695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42904 (local address 127.10.30.66:36797)
0812 20:58:38.970920 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:38.970928 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:38.971475 (+ 547us) server_negotiation.cc:407] Connection header received
0812 20:58:38.971564 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:38.971567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:38.971586 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:38.971676 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:38.971797 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.972897 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.974142 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.975038 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.975101 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.975187 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:38.975404 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 20:58:38.975850 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":135,"threads_started":1}
I20260812 20:58:38.976469 23905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:38.970271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:32771 (local address 127.0.0.1:54832)
0812 20:58:38.970976 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:38.970989 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:38.971100 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:38.971368 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:38.971369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:38.971371 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:38.971458 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.971460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.973018 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.973019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.974141 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:38.974143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:38.974927 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:38.974929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:38.975027 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:38.975055 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 20:58:38.975126 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 20:58:38.975200 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":74,"threads_started":1}
I20260812 20:58:38.976826 23473 tablet_service.cc:1467] Processing CreateTablet for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d (DEFAULT_TABLE table=test-table [id=dbabbb63ad924bf396b9f0782219b3ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:38.976831 23729 tablet_service.cc:1467] Processing CreateTablet for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d (DEFAULT_TABLE table=test-table [id=dbabbb63ad924bf396b9f0782219b3ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:38.977332 23729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:38.977331 23473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:38.977293 23213 tablet_service.cc:1467] Processing CreateTablet for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d (DEFAULT_TABLE table=test-table [id=dbabbb63ad924bf396b9f0782219b3ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:38.977699 23213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:38.981359 23920 tablet_bootstrap.cc:492] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Bootstrap starting.
I20260812 20:58:38.982133 23925 tablet_bootstrap.cc:492] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Bootstrap starting.
I20260812 20:58:38.982663 23926 tablet_bootstrap.cc:492] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Bootstrap starting.
I20260812 20:58:38.982787 23920 tablet_bootstrap.cc:654] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:38.983071 23925 tablet_bootstrap.cc:654] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:38.983290 23920 log.cc:824] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:38.983530 23925 log.cc:824] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:38.983695 23926 tablet_bootstrap.cc:654] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:38.984095 23926 log.cc:824] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:38.984401 23920 tablet_bootstrap.cc:492] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: No bootstrap required, opened a new log
I20260812 20:58:38.984472 23925 tablet_bootstrap.cc:492] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: No bootstrap required, opened a new log
I20260812 20:58:38.984517 23920 ts_tablet_manager.cc:1397] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 20:58:38.984591 23925 ts_tablet_manager.cc:1397] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 20:58:38.984943 23926 tablet_bootstrap.cc:492] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: No bootstrap required, opened a new log
I20260812 20:58:38.985110 23926 ts_tablet_manager.cc:1397] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 20:58:38.986827 23926 raft_consensus.cc:348] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:38.987061 23926 raft_consensus.cc:374] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:38.987118 23926 raft_consensus.cc:729] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395b85521bb4475c82d7665a33ff811e, State: Initialized, Role: FOLLOWER
I20260812 20:58:38.986974 23925 raft_consensus.cc:348] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:38.986974 23920 raft_consensus.cc:348] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:38.987188 23925 raft_consensus.cc:374] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:38.987188 23920 raft_consensus.cc:374] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:38.987234 23925 raft_consensus.cc:729] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28f973828a74476d883c077bb307b13e, State: Initialized, Role: FOLLOWER
I20260812 20:58:38.987234 23920 raft_consensus.cc:729] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2bfdf251a884d44bd00f67c26c69df1, State: Initialized, Role: FOLLOWER
I20260812 20:58:38.987293 23926 consensus_queue.cc:260] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:38.987347 23920 consensus_queue.cc:260] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:38.987347 23925 consensus_queue.cc:260] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:38.987660 23920 ts_tablet_manager.cc:1428] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 20:58:38.987660 23925 ts_tablet_manager.cc:1428] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 20:58:38.987676 23595 heartbeater.cc:503] Master 127.10.30.126:37525 was elected leader, sending a full tablet report...
I20260812 20:58:38.987798 23862 heartbeater.cc:503] Master 127.10.30.126:37525 was elected leader, sending a full tablet report...
I20260812 20:58:38.987661 23926 ts_tablet_manager.cc:1428] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260812 20:58:38.988766 23338 heartbeater.cc:503] Master 127.10.30.126:37525 was elected leader, sending a full tablet report...
W20260812 20:58:39.006147 23340 tablet.cc:2369] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 20:58:39.157699 23863 tablet.cc:2369] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:39.203714 23934 raft_consensus.cc:482] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 20:58:39.203878 23597 tablet.cc:2369] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:58:39.204056 23934 raft_consensus.cc:504] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:39.204586 23934 leader_election.cc:288] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28f973828a74476d883c077bb307b13e (127.10.30.67:35191), 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797)
I20260812 20:58:39.208114 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.205067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:51031 (local address 127.10.30.66:36797)
0812 20:58:39.205129 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.205131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.205142 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:39.205210 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.205211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.205222 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.205300 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:39.205523 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.206089 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.207337 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.207727 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.207832 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.207845 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.207980 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.208023 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 20:58:39.208133 23935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.204843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:36797 (local address 127.10.30.65:51031)
0812 20:58:39.205042 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.205058 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.205128 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.205308 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.205309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.205313 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:39.205409 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.205411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.206183 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.206184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.207246 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.207249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.207814 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.207815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.207897 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.207901 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.207975 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.208024 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":62,"thread_start_us":96,"threads_started":1}
I20260812 20:58:39.208344 23936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.204843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:35191 (local address 127.10.30.65:58549)
0812 20:58:39.205073 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.205086 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.205168 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.205345 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.205345 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.205348 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:39.205453 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.205455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.206161 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.206162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.207288 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.207297 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.208017 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.208018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.208098 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.208102 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.208176 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.208233 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":50,"thread_start_us":90,"threads_started":1}
I20260812 20:58:39.208600 23510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dbef30ecd664a4dbcd8e53ab4ac1b4d" candidate_uuid: "b2bfdf251a884d44bd00f67c26c69df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395b85521bb4475c82d7665a33ff811e" is_pre_election: true
I20260812 20:58:39.208701 23910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.205073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:58549 (local address 127.10.30.67:35191)
0812 20:58:39.205138 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.205140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.205149 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:39.205255 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.205256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.205271 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.205341 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:39.205538 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.206056 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.207380 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.207842 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.208016 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.208029 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.208597 (+ 568us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.208644 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 20:58:39.208786 23510 raft_consensus.cc:2454] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2bfdf251a884d44bd00f67c26c69df1 in term 0.
I20260812 20:58:39.209112 23776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dbef30ecd664a4dbcd8e53ab4ac1b4d" candidate_uuid: "b2bfdf251a884d44bd00f67c26c69df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f973828a74476d883c077bb307b13e" is_pre_election: true
I20260812 20:58:39.209298 23776 raft_consensus.cc:2454] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2bfdf251a884d44bd00f67c26c69df1 in term 0.
I20260812 20:58:39.209610 23118 leader_election.cc:302] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 395b85521bb4475c82d7665a33ff811e, b2bfdf251a884d44bd00f67c26c69df1; no voters:
I20260812 20:58:39.209789 23934 raft_consensus.cc:2781] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:39.209875 23934 raft_consensus.cc:482] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:39.209914 23934 raft_consensus.cc:3037] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.210892 23934 raft_consensus.cc:504] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:39.211099 23934 leader_election.cc:288] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [CANDIDATE]: Term 1 election: Requested vote from peers 28f973828a74476d883c077bb307b13e (127.10.30.67:35191), 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797)
I20260812 20:58:39.211289 23776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dbef30ecd664a4dbcd8e53ab4ac1b4d" candidate_uuid: "b2bfdf251a884d44bd00f67c26c69df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f973828a74476d883c077bb307b13e"
I20260812 20:58:39.211292 23510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dbef30ecd664a4dbcd8e53ab4ac1b4d" candidate_uuid: "b2bfdf251a884d44bd00f67c26c69df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395b85521bb4475c82d7665a33ff811e"
I20260812 20:58:39.211383 23510 raft_consensus.cc:3037] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.211383 23776 raft_consensus.cc:3037] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.212456 23776 raft_consensus.cc:2454] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2bfdf251a884d44bd00f67c26c69df1 in term 1.
I20260812 20:58:39.212456 23510 raft_consensus.cc:2454] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2bfdf251a884d44bd00f67c26c69df1 in term 1.
I20260812 20:58:39.212674 23122 leader_election.cc:302] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28f973828a74476d883c077bb307b13e, b2bfdf251a884d44bd00f67c26c69df1; no voters:
I20260812 20:58:39.212800 23934 raft_consensus.cc:2781] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:39.212945 23934 raft_consensus.cc:686] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 1 LEADER]: Becoming Leader. State: Replica: b2bfdf251a884d44bd00f67c26c69df1, State: Running, Role: LEADER
I20260812 20:58:39.213073 23934 consensus_queue.cc:237] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } }
I20260812 20:58:39.214267 22938 catalog_manager.cc:5495] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "b2bfdf251a884d44bd00f67c26c69df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:39.264127 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.261080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54838 (local address 127.10.30.65:32771)
0812 20:58:39.261175 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.261177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.261205 (+ 28us) server_negotiation.cc:407] Connection header received
0812 20:58:39.261260 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.261261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.261285 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.261361 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:39.261555 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.262120 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.263062 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.263291 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.263371 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.263602 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:39.263766 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:39.263843 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.263962 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.263989 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 20:58:39.266604 23776 raft_consensus.cc:1261] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Refusing update from remote peer b2bfdf251a884d44bd00f67c26c69df1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:39.266604 23510 raft_consensus.cc:1261] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Refusing update from remote peer b2bfdf251a884d44bd00f67c26c69df1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:39.267127 23934 consensus_queue.cc:1035] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:39.267339 23940 consensus_queue.cc:1035] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:39.270279 23943 mvcc.cc:205] Tried to move back new op lower bound from 7317783835712221184 to 7317783835497570304. Current Snapshot: MvccSnapshot[applied={T|T < 7317783835712221184}]
I20260812 20:58:39.270594 23950 mvcc.cc:205] Tried to move back new op lower bound from 7317783835712221184 to 7317783835497570304. Current Snapshot: MvccSnapshot[applied={T|T < 7317783835712221184}]
I20260812 20:58:39.275336 22938 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:39.275472 22938 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:39.276399 22938 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: Sending DeleteTablet for 3 replicas of tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d
I20260812 20:58:39.276769 23213 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:54832
I20260812 20:58:39.276809 23729 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:41922
I20260812 20:58:39.277103 23473 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:42904
I20260812 20:58:39.277343 23963 tablet_replica.cc:330] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: stopping tablet replica
I20260812 20:58:39.277486 23963 raft_consensus.cc:2229] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:39.277634 23963 raft_consensus.cc:2258] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.277680 22938 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:39.277871 22938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:39.278393 23963 ts_tablet_manager.cc:1905] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.279480 23729 tablet_service.cc:1467] Processing CreateTablet for tablet 8e84e05d991f4f5aa875b7b851dbe322 (DEFAULT_TABLE table=test-table [id=8c655ab1c79e4b3887921be7137b3952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.279556 23213 tablet_service.cc:1467] Processing CreateTablet for tablet 8e84e05d991f4f5aa875b7b851dbe322 (DEFAULT_TABLE table=test-table [id=8c655ab1c79e4b3887921be7137b3952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.279654 23729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e84e05d991f4f5aa875b7b851dbe322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.279713 23213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e84e05d991f4f5aa875b7b851dbe322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.280787 23963 ts_tablet_manager.cc:1918] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:39.280898 23963 log.cc:1196] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/9dbef30ecd664a4dbcd8e53ab4ac1b4d
I20260812 20:58:39.281204 23963 ts_tablet_manager.cc:1939] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 395b85521bb4475c82d7665a33ff811e: Deleting consensus metadata
I20260812 20:58:39.281343 23925 tablet_bootstrap.cc:492] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: Bootstrap starting.
I20260812 20:58:39.281399 23473 tablet_service.cc:1467] Processing CreateTablet for tablet 8e84e05d991f4f5aa875b7b851dbe322 (DEFAULT_TABLE table=test-table [id=8c655ab1c79e4b3887921be7137b3952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.281543 23473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e84e05d991f4f5aa875b7b851dbe322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.281657 23920 tablet_bootstrap.cc:492] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: Bootstrap starting.
I20260812 20:58:39.281945 23925 tablet_bootstrap.cc:654] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.282207 23920 tablet_bootstrap.cc:654] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.282934 22916 catalog_manager.cc:4841] TS 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797): tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d (table test-table [id=dbabbb63ad924bf396b9f0782219b3ed]) successfully deleted
I20260812 20:58:39.283365 23920 tablet_bootstrap.cc:492] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: No bootstrap required, opened a new log
I20260812 20:58:39.283432 23920 ts_tablet_manager.cc:1397] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 20:58:39.283529 23926 tablet_bootstrap.cc:492] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: Bootstrap starting.
I20260812 20:58:39.283564 23925 tablet_bootstrap.cc:492] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: No bootstrap required, opened a new log
I20260812 20:58:39.283607 23925 ts_tablet_manager.cc:1397] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 20:58:39.283635 23920 raft_consensus.cc:348] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.283741 23920 raft_consensus.cc:374] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.283761 23920 raft_consensus.cc:729] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2bfdf251a884d44bd00f67c26c69df1, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.283820 23920 consensus_queue.cc:260] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.283806 23925 raft_consensus.cc:348] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.283892 23925 raft_consensus.cc:374] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.283921 23920 ts_tablet_manager.cc:1428] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:39.283941 23925 raft_consensus.cc:729] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28f973828a74476d883c077bb307b13e, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.284018 23926 tablet_bootstrap.cc:654] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.283996 23925 consensus_queue.cc:260] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.284108 23925 ts_tablet_manager.cc:1428] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 20:58:39.285063 23926 tablet_bootstrap.cc:492] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: No bootstrap required, opened a new log
I20260812 20:58:39.285123 23926 ts_tablet_manager.cc:1397] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260812 20:58:39.285284 23926 raft_consensus.cc:348] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.285370 23926 raft_consensus.cc:374] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.285395 23926 raft_consensus.cc:729] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395b85521bb4475c82d7665a33ff811e, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.285442 23926 consensus_queue.cc:260] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.285557 23926 ts_tablet_manager.cc:1428] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:39.286108 23962 tablet_replica.cc:330] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: stopping tablet replica
I20260812 20:58:39.286619 23962 raft_consensus.cc:2229] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:39.286782 23962 raft_consensus.cc:2258] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.287178 23961 tablet_replica.cc:330] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: stopping tablet replica
I20260812 20:58:39.287312 23961 raft_consensus.cc:2229] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:39.287477 23961 raft_consensus.cc:2258] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.287474 23962 ts_tablet_manager.cc:1905] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.288254 23961 ts_tablet_manager.cc:1905] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.289438 23962 ts_tablet_manager.cc:1918] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:39.289561 23962 log.cc:1196] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/9dbef30ecd664a4dbcd8e53ab4ac1b4d
I20260812 20:58:39.289914 23962 ts_tablet_manager.cc:1939] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P 28f973828a74476d883c077bb307b13e: Deleting consensus metadata
I20260812 20:58:39.290027 23961 ts_tablet_manager.cc:1918] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:39.290107 23961 log.cc:1196] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/9dbef30ecd664a4dbcd8e53ab4ac1b4d
I20260812 20:58:39.290449 22920 catalog_manager.cc:4841] TS 28f973828a74476d883c077bb307b13e (127.10.30.67:35191): tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d (table test-table [id=dbabbb63ad924bf396b9f0782219b3ed]) successfully deleted
I20260812 20:58:39.290499 23961 ts_tablet_manager.cc:1939] T 9dbef30ecd664a4dbcd8e53ab4ac1b4d P b2bfdf251a884d44bd00f67c26c69df1: Deleting consensus metadata
I20260812 20:58:39.291074 22916 catalog_manager.cc:4841] TS b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771): tablet 9dbef30ecd664a4dbcd8e53ab4ac1b4d (table test-table [id=dbabbb63ad924bf396b9f0782219b3ed]) successfully deleted
I20260812 20:58:39.436304 23931 raft_consensus.cc:482] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:39.436491 23931 raft_consensus.cc:504] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.436902 23931 leader_election.cc:288] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771), 28f973828a74476d883c077bb307b13e (127.10.30.67:35191)
I20260812 20:58:39.440712 23910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.437310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:47369 (local address 127.10.30.67:35191)
0812 20:58:39.437397 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.437401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.437659 (+ 258us) server_negotiation.cc:407] Connection header received
0812 20:58:39.437737 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.437739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.437756 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.437823 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:39.438016 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.438519 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.439738 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.440240 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.440303 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.440314 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.440535 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.440594 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 20:58:39.440706 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.437326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:46459 (local address 127.10.30.65:32771)
0812 20:58:39.437408 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.437411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.437524 (+ 113us) server_negotiation.cc:407] Connection header received
0812 20:58:39.437618 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.437619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.437640 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.437714 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:39.437957 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.438516 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.439794 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.440313 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.440397 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.440407 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.440559 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.440611 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 20:58:39.440748 23971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.437216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:35191 (local address 127.10.30.66:47369)
0812 20:58:39.437550 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.437562 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.437660 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.437839 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.437839 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.437841 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:39.437934 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.437935 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.438614 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.438615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.439641 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.439644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.440347 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.440349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.440446 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.440453 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.440505 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.440581 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":187,"thread_start_us":110,"threads_started":1}
I20260812 20:58:39.440786 23969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.437216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:32771 (local address 127.10.30.66:46459)
0812 20:58:39.437413 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.437428 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.437533 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.437734 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.437735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.437738 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:39.437862 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.437865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.438613 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.438614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.439675 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.439678 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.440405 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.440405 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.440463 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.440466 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.440541 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.440589 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":61,"thread_start_us":99,"threads_started":1}
I20260812 20:58:39.441179 23776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e84e05d991f4f5aa875b7b851dbe322" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f973828a74476d883c077bb307b13e" is_pre_election: true
I20260812 20:58:39.441321 23776 raft_consensus.cc:2454] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 0.
I20260812 20:58:39.441315 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e84e05d991f4f5aa875b7b851dbe322" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2bfdf251a884d44bd00f67c26c69df1" is_pre_election: true
I20260812 20:58:39.441520 23255 raft_consensus.cc:2454] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 0.
I20260812 20:58:39.441558 23391 leader_election.cc:302] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28f973828a74476d883c077bb307b13e, 395b85521bb4475c82d7665a33ff811e; no voters:
I20260812 20:58:39.441738 23931 raft_consensus.cc:2781] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:39.441788 23931 raft_consensus.cc:482] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:39.441804 23931 raft_consensus.cc:3037] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.442711 23931 raft_consensus.cc:504] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.442888 23931 leader_election.cc:288] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 election: Requested vote from peers b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771), 28f973828a74476d883c077bb307b13e (127.10.30.67:35191)
I20260812 20:58:39.443104 23776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e84e05d991f4f5aa875b7b851dbe322" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f973828a74476d883c077bb307b13e"
I20260812 20:58:39.443197 23776 raft_consensus.cc:3037] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.443970 23776 raft_consensus.cc:2454] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 1.
I20260812 20:58:39.444147 23391 leader_election.cc:302] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28f973828a74476d883c077bb307b13e, 395b85521bb4475c82d7665a33ff811e; no voters:
I20260812 20:58:39.444118 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e84e05d991f4f5aa875b7b851dbe322" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2bfdf251a884d44bd00f67c26c69df1"
I20260812 20:58:39.444218 23255 raft_consensus.cc:3037] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.444324 23931 raft_consensus.cc:2781] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:39.444550 23931 raft_consensus.cc:686] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 1 LEADER]: Becoming Leader. State: Replica: 395b85521bb4475c82d7665a33ff811e, State: Running, Role: LEADER
I20260812 20:58:39.444634 23931 consensus_queue.cc:237] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.445448 23255 raft_consensus.cc:2454] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 1.
I20260812 20:58:39.446177 22938 catalog_manager.cc:5495] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e reported cstate change: term changed from 0 to 1, leader changed from <none> to 395b85521bb4475c82d7665a33ff811e (127.10.30.66). New cstate: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } health_report { overall_health: UNKNOWN } } }
Aug 12 20:58:39 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568318, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.126@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:39.496531 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.488110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41902 (local address 127.10.30.126:37525)
0812 20:58:39.488417 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.488419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.488429 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:39.488548 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.488548 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.488563 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.488657 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:39.489295 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.489862 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.490625 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.490849 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.490940 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.493561 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:39.493562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:39.493563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:39.493570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:39.495064 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:39.495493 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:39.495494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:39.495494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:39.495585 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:39.495842 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:39.495843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:39.495843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:39.495983 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:39.496063 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.496265 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.496391 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":287,"thread_start_us":100,"threads_started":1}
I20260812 20:58:39.496538 23983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.488080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:37525 (local address 127.0.0.1:41902)
0812 20:58:39.488326 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.488347 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.488472 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.488662 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.488663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.489115 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:39.489192 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.489196 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.489950 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.489951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.490515 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.490516 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.490942 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.490943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.491033 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.491726 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:39.491732 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:39.493450 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:39.495147 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:39.495155 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:39.495157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:39.495404 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:39.495659 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:39.495660 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:39.495661 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:39.495763 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:39.496095 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:39.496103 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:39.496157 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.496229 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.496446 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":95,"thread_start_us":108,"threads_started":1}
I20260812 20:58:39.499607 22938 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:41902:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 20:58:39.499907 22938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:39.501868 23473 tablet_service.cc:1467] Processing CreateTablet for tablet 115b6219ac614090b56b067c45480dba (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=947dcef5db08498c956bd389d8cdf9e0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:39.501864 23213 tablet_service.cc:1467] Processing CreateTablet for tablet 115b6219ac614090b56b067c45480dba (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=947dcef5db08498c956bd389d8cdf9e0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:39.501847 23729 tablet_service.cc:1467] Processing CreateTablet for tablet 115b6219ac614090b56b067c45480dba (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=947dcef5db08498c956bd389d8cdf9e0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 20:58:39.502100 23473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 115b6219ac614090b56b067c45480dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.502100 23729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 115b6219ac614090b56b067c45480dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.502110 23213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 115b6219ac614090b56b067c45480dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.503823 23926 tablet_bootstrap.cc:492] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: Bootstrap starting.
I20260812 20:58:39.504076 23925 tablet_bootstrap.cc:492] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: Bootstrap starting.
I20260812 20:58:39.504066 23920 tablet_bootstrap.cc:492] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: Bootstrap starting.
I20260812 20:58:39.504405 23926 tablet_bootstrap.cc:654] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.504503 23920 tablet_bootstrap.cc:654] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.504558 23925 tablet_bootstrap.cc:654] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.505297 23926 tablet_bootstrap.cc:492] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: No bootstrap required, opened a new log
I20260812 20:58:39.505359 23926 ts_tablet_manager.cc:1397] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 20:58:39.505470 23920 tablet_bootstrap.cc:492] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: No bootstrap required, opened a new log
I20260812 20:58:39.505517 23920 ts_tablet_manager.cc:1397] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:39.505566 23926 raft_consensus.cc:348] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.505652 23926 raft_consensus.cc:374] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.505674 23926 raft_consensus.cc:729] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395b85521bb4475c82d7665a33ff811e, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.505642 23920 raft_consensus.cc:348] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.505709 23920 raft_consensus.cc:374] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.505730 23920 raft_consensus.cc:729] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2bfdf251a884d44bd00f67c26c69df1, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.505725 23926 consensus_queue.cc:260] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.505774 23920 consensus_queue.cc:260] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.505837 23926 ts_tablet_manager.cc:1428] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:39.505868 23920 ts_tablet_manager.cc:1428] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:39.506013 23931 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.506106 23931 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:39.506278 23934 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.506368 23934 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:39.507797 23925 tablet_bootstrap.cc:492] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: No bootstrap required, opened a new log
I20260812 20:58:39.507869 23925 ts_tablet_manager.cc:1397] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260812 20:58:39.508071 23925 raft_consensus.cc:348] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.508154 23925 raft_consensus.cc:374] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.508188 23925 raft_consensus.cc:729] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28f973828a74476d883c077bb307b13e, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.508258 23925 consensus_queue.cc:260] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.508406 23925 ts_tablet_manager.cc:1428] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 20:58:39.508503 23933 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.508615 23933 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:39.576447 23931 raft_consensus.cc:482] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:39.576617 23931 raft_consensus.cc:504] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.576946 23931 leader_election.cc:288] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28f973828a74476d883c077bb307b13e (127.10.30.67:35191), b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771)
I20260812 20:58:39.577260 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b6219ac614090b56b067c45480dba" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2bfdf251a884d44bd00f67c26c69df1" is_pre_election: true
I20260812 20:58:39.577298 23776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b6219ac614090b56b067c45480dba" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f973828a74476d883c077bb307b13e" is_pre_election: true
I20260812 20:58:39.577391 23255 raft_consensus.cc:2454] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 0.
I20260812 20:58:39.577463 23776 raft_consensus.cc:2454] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 0.
I20260812 20:58:39.577678 23389 leader_election.cc:302] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 395b85521bb4475c82d7665a33ff811e, b2bfdf251a884d44bd00f67c26c69df1; no voters:
I20260812 20:58:39.577855 23931 raft_consensus.cc:2781] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:39.577971 23931 raft_consensus.cc:482] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:39.578011 23931 raft_consensus.cc:3037] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.578948 23931 raft_consensus.cc:504] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.579154 23931 leader_election.cc:288] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 election: Requested vote from peers 28f973828a74476d883c077bb307b13e (127.10.30.67:35191), b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771)
I20260812 20:58:39.579334 23776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b6219ac614090b56b067c45480dba" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f973828a74476d883c077bb307b13e"
I20260812 20:58:39.579376 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b6219ac614090b56b067c45480dba" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2bfdf251a884d44bd00f67c26c69df1"
I20260812 20:58:39.579452 23776 raft_consensus.cc:3037] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.579496 23255 raft_consensus.cc:3037] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.580245 23776 raft_consensus.cc:2454] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 1.
I20260812 20:58:39.580268 23255 raft_consensus.cc:2454] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 1.
I20260812 20:58:39.580438 23391 leader_election.cc:302] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28f973828a74476d883c077bb307b13e, 395b85521bb4475c82d7665a33ff811e; no voters:
I20260812 20:58:39.580591 23931 raft_consensus.cc:2781] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:39.580662 23931 raft_consensus.cc:686] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [term 1 LEADER]: Becoming Leader. State: Replica: 395b85521bb4475c82d7665a33ff811e, State: Running, Role: LEADER
I20260812 20:58:39.580736 23931 consensus_queue.cc:237] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } }
I20260812 20:58:39.581179 23974 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: TxnStatusTablet state changed. Reason: New leader 395b85521bb4475c82d7665a33ff811e. Latest consensus state: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.581288 23974 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:39.581558 23997 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 20:58:39.581583 22938 catalog_manager.cc:5495] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e reported cstate change: term changed from 0 to 1, leader changed from <none> to 395b85521bb4475c82d7665a33ff811e (127.10.30.66). New cstate: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:39.581723 23997 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 20:58:39.603113 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.600180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42914 (local address 127.10.30.66:36797)
0812 20:58:39.600257 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.600259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.600269 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:39.600331 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.600332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.600367 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.600448 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:39.600628 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.601191 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.602048 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.602281 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.602386 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.602616 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:39.602756 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:39.602864 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.602921 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.602948 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 20:58:39.603087 23983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.600060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:36797 (local address 127.0.0.1:42914)
0812 20:58:39.600153 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.600167 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.600228 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.600455 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.600456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.600458 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:39.600531 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.600534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.601323 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.601325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.601952 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.601954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.602390 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.602391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.602475 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.602499 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:39.602854 (+ 355us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:39.602866 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.602917 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.602984 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 20:58:39.604944 23776 raft_consensus.cc:1261] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Refusing update from remote peer 395b85521bb4475c82d7665a33ff811e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:39.604993 23255 raft_consensus.cc:1261] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Refusing update from remote peer 395b85521bb4475c82d7665a33ff811e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:39.605367 23931 consensus_queue.cc:1035] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:39.605583 23974 consensus_queue.cc:1035] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:39.606555 23933 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: TxnStatusTablet state changed. Reason: New leader 395b85521bb4475c82d7665a33ff811e. Latest consensus state: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.606715 23933 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:39.606693 23934 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: TxnStatusTablet state changed. Reason: New leader 395b85521bb4475c82d7665a33ff811e. Latest consensus state: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.606827 23934 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:39.607851 23974 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.607964 23946 mvcc.cc:205] Tried to move back new op lower bound from 7317783837098455040 to 7317783837003018240. Current Snapshot: MvccSnapshot[applied={T|T < 7317783837098455040}]
I20260812 20:58:39.607973 23974 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:39.608248 23931 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.608330 23931 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P 395b85521bb4475c82d7665a33ff811e: This TxnStatusTablet replica's current role is: LEADER
I20260812 20:58:39.608520 23934 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.608623 23934 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P b2bfdf251a884d44bd00f67c26c69df1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:39.609460 23933 tablet_replica.cc:439] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } } peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } }
I20260812 20:58:39.609560 23933 tablet_replica.cc:442] T 115b6219ac614090b56b067c45480dba P 28f973828a74476d883c077bb307b13e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 20:58:39.612705 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.610052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42916 (local address 127.10.30.66:36797)
0812 20:58:39.610104 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.610106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.610116 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:39.610196 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.610197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.610209 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.610275 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:39.610407 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.611079 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.611877 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.612146 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.612227 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.612400 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:39.612440 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:39.612506 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.612584 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.612610 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 20:58:39.619361 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.616489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:47587 (local address 127.10.30.66:36797)
0812 20:58:39.616535 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.616537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.616715 (+ 178us) server_negotiation.cc:407] Connection header received
0812 20:58:39.616784 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.616785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.616811 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.616868 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:39.617035 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.617541 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.618493 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.618687 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.618776 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.619048 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:39.619092 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:39.619163 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.619213 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.619240 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 20:58:39.619366 24005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.616426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:36797 (local address 127.10.30.66:47587)
0812 20:58:39.616628 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.616638 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.616734 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.616871 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.616872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.616873 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 20:58:39.616960 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.616962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.617638 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.617639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.618402 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.618405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.618800 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.618801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.618876 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.618892 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 20:58:39.619168 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 20:58:39.619170 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.619207 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.619250 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":6,"thread_start_us":119,"threads_started":1}
I20260812 20:58:39.622269 23776 raft_consensus.cc:1261] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Refusing update from remote peer 395b85521bb4475c82d7665a33ff811e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:39.622310 23255 raft_consensus.cc:1261] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Refusing update from remote peer 395b85521bb4475c82d7665a33ff811e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:39.622555 23974 consensus_queue.cc:1035] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:39.622737 24002 consensus_queue.cc:1035] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:39.640235 22938 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:39.640429 22938 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:39.641373 22938 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: Sending DeleteTablet for 3 replicas of tablet 8e84e05d991f4f5aa875b7b851dbe322
I20260812 20:58:39.641738 23729 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e84e05d991f4f5aa875b7b851dbe322 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:41922
I20260812 20:58:39.641779 23213 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e84e05d991f4f5aa875b7b851dbe322 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:54832
I20260812 20:58:39.641837 23472 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e84e05d991f4f5aa875b7b851dbe322 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:42904
I20260812 20:58:39.641911 23961 tablet_replica.cc:330] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: stopping tablet replica
I20260812 20:58:39.641988 23961 raft_consensus.cc:2229] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:39.642028 23962 tablet_replica.cc:330] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: stopping tablet replica
I20260812 20:58:39.642059 23961 raft_consensus.cc:2258] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.642112 23962 raft_consensus.cc:2229] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:39.642174 23962 raft_consensus.cc:2258] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.642288 23963 tablet_replica.cc:330] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: stopping tablet replica
I20260812 20:58:39.642364 23963 raft_consensus.cc:2229] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:39.642439 23961 ts_tablet_manager.cc:1905] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.642510 23963 raft_consensus.cc:2258] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.642616 23962 ts_tablet_manager.cc:1905] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.643168 23963 ts_tablet_manager.cc:1905] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.645119 23962 ts_tablet_manager.cc:1918] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:39.645202 23962 log.cc:1196] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/8e84e05d991f4f5aa875b7b851dbe322
I20260812 20:58:39.645301 23963 ts_tablet_manager.cc:1918] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:39.645375 23963 log.cc:1196] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/8e84e05d991f4f5aa875b7b851dbe322
I20260812 20:58:39.645471 23962 ts_tablet_manager.cc:1939] T 8e84e05d991f4f5aa875b7b851dbe322 P 28f973828a74476d883c077bb307b13e: Deleting consensus metadata
I20260812 20:58:39.645656 23963 ts_tablet_manager.cc:1939] T 8e84e05d991f4f5aa875b7b851dbe322 P 395b85521bb4475c82d7665a33ff811e: Deleting consensus metadata
I20260812 20:58:39.646215 22916 catalog_manager.cc:4841] TS 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797): tablet 8e84e05d991f4f5aa875b7b851dbe322 (table test-table [id=8c655ab1c79e4b3887921be7137b3952]) successfully deleted
I20260812 20:58:39.648029 23961 ts_tablet_manager.cc:1918] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:39.648123 23961 log.cc:1196] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/8e84e05d991f4f5aa875b7b851dbe322
I20260812 20:58:39.648381 23961 ts_tablet_manager.cc:1939] T 8e84e05d991f4f5aa875b7b851dbe322 P b2bfdf251a884d44bd00f67c26c69df1: Deleting consensus metadata
I20260812 20:58:39.648849 22916 catalog_manager.cc:4841] TS b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771): tablet 8e84e05d991f4f5aa875b7b851dbe322 (table test-table [id=8c655ab1c79e4b3887921be7137b3952]) successfully deleted
I20260812 20:58:39.648849 22920 catalog_manager.cc:4841] TS 28f973828a74476d883c077bb307b13e (127.10.30.67:35191): tablet 8e84e05d991f4f5aa875b7b851dbe322 (table test-table [id=8c655ab1c79e4b3887921be7137b3952]) successfully deleted
Aug 12 20:58:39 dist-test-slave-h3ft krb5kdc[22858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 20:58:39 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:39 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 20:58:39.679088 23984 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:39.671046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41904 (local address 127.10.30.126:37525)
0812 20:58:39.671125 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.671129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.671333 (+ 204us) server_negotiation.cc:407] Connection header received
0812 20:58:39.671417 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.671418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.671431 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.671495 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:39.672399 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.673023 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.674200 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.674495 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.674556 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.678965 (+ 4409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41904: BlockingRecv error: recv got EOF from 127.0.0.1:41904 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 20:58:39 dist-test-slave-h3ft krb5kdc[22858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM
I20260812 20:58:39.690397 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.680468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41920 (local address 127.10.30.126:37525)
0812 20:58:39.680517 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.680520 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.680623 (+ 103us) server_negotiation.cc:407] Connection header received
0812 20:58:39.680700 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.680701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.680713 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.680765 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:39.681353 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.682092 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.683139 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.683589 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.683672 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.687194 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:39.687196 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:39.687197 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:39.687207 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:39.688983 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:39.689380 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:39.689382 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:39.689382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:39.689460 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:39.689674 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:39.689676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:39.689676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:39.689852 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:39.689977 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.690163 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.690266 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 20:58:39.692468 22938 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:39.692739 22938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:39.695154 23213 tablet_service.cc:1467] Processing CreateTablet for tablet 91b28ac3cbbd4b60a35e09ac35b2706f (DEFAULT_TABLE table=test-table [id=a1032cfe6b074e37bcbb49d3a3d03116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.695256 23472 tablet_service.cc:1467] Processing CreateTablet for tablet 91b28ac3cbbd4b60a35e09ac35b2706f (DEFAULT_TABLE table=test-table [id=a1032cfe6b074e37bcbb49d3a3d03116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.695407 23213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91b28ac3cbbd4b60a35e09ac35b2706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.695478 23472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91b28ac3cbbd4b60a35e09ac35b2706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.697079 23926 tablet_bootstrap.cc:492] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: Bootstrap starting.
I20260812 20:58:39.697288 23920 tablet_bootstrap.cc:492] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: Bootstrap starting.
I20260812 20:58:39.697687 23920 tablet_bootstrap.cc:654] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.697690 23926 tablet_bootstrap.cc:654] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.698189 23729 tablet_service.cc:1467] Processing CreateTablet for tablet 91b28ac3cbbd4b60a35e09ac35b2706f (DEFAULT_TABLE table=test-table [id=a1032cfe6b074e37bcbb49d3a3d03116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.698377 23729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91b28ac3cbbd4b60a35e09ac35b2706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.700160 23925 tablet_bootstrap.cc:492] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: Bootstrap starting.
I20260812 20:58:39.700529 23920 tablet_bootstrap.cc:492] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: No bootstrap required, opened a new log
I20260812 20:58:39.700599 23920 ts_tablet_manager.cc:1397] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260812 20:58:39.700738 23925 tablet_bootstrap.cc:654] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.700793 23920 raft_consensus.cc:348] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.700891 23920 raft_consensus.cc:374] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.700918 23920 raft_consensus.cc:729] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2bfdf251a884d44bd00f67c26c69df1, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.700968 23920 consensus_queue.cc:260] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.701078 23920 ts_tablet_manager.cc:1428] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 20:58:39.701992 23925 tablet_bootstrap.cc:492] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: No bootstrap required, opened a new log
I20260812 20:58:39.702065 23925 ts_tablet_manager.cc:1397] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 20:58:39.702065 23926 tablet_bootstrap.cc:492] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: No bootstrap required, opened a new log
I20260812 20:58:39.702121 23926 ts_tablet_manager.cc:1397] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260812 20:58:39.702291 23925 raft_consensus.cc:348] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.702363 23925 raft_consensus.cc:374] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.702380 23925 raft_consensus.cc:729] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28f973828a74476d883c077bb307b13e, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.702427 23925 consensus_queue.cc:260] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.702468 23926 raft_consensus.cc:348] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.702538 23925 ts_tablet_manager.cc:1428] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 20:58:39.702584 23926 raft_consensus.cc:374] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.702615 23926 raft_consensus.cc:729] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395b85521bb4475c82d7665a33ff811e, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.702672 23926 consensus_queue.cc:260] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.702795 23926 ts_tablet_manager.cc:1428] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:39.815182 23933 raft_consensus.cc:482] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:39.815371 23933 raft_consensus.cc:504] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.815912 23933 leader_election.cc:288] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771), 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797)
I20260812 20:58:39.820143 24035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.816453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:36797 (local address 127.10.30.67:59851)
0812 20:58:39.816571 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.816581 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.816630 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.816861 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.816862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.816865 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:39.816966 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.816968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.817965 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.817966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.819129 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.819133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.819844 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.819845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.819921 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.819926 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.819979 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.820026 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":86,"thread_start_us":74,"threads_started":1}
I20260812 20:58:39.820144 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.816615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:59851 (local address 127.10.30.66:36797)
0812 20:58:39.816717 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.816719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.816729 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:39.816762 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.816763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.816777 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.816837 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:39.817057 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.817785 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.819231 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.819752 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.819828 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.819841 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.820004 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.820063 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 20:58:39.820575 23510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b28ac3cbbd4b60a35e09ac35b2706f" candidate_uuid: "28f973828a74476d883c077bb307b13e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395b85521bb4475c82d7665a33ff811e" is_pre_election: true
I20260812 20:58:39.820664 24034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.816194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:32771 (local address 127.10.30.67:55835)
0812 20:58:39.816368 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:39.816382 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:39.816466 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:39.816683 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:39.816684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:39.816687 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:58:39.816806 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.816809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.817886 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.817887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.819648 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:39.819652 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.820426 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.820427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:39.820494 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.820498 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:58:39.820550 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 20:58:39.820587 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":25,"thread_start_us":115,"threads_started":1}
I20260812 20:58:39.820695 23510 raft_consensus.cc:2454] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28f973828a74476d883c077bb307b13e in term 0.
I20260812 20:58:39.820933 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.816283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:55835 (local address 127.10.30.65:32771)
0812 20:58:39.816354 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.816357 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.816530 (+ 173us) server_negotiation.cc:407] Connection header received
0812 20:58:39.816572 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.816573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.816585 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.816668 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:58:39.816899 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.817787 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.819750 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.820342 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.820422 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.820434 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.820800 (+ 366us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.820860 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 20:58:39.820935 23640 leader_election.cc:302] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28f973828a74476d883c077bb307b13e, 395b85521bb4475c82d7665a33ff811e; no voters:
I20260812 20:58:39.821106 23933 raft_consensus.cc:2781] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:39.821141 23933 raft_consensus.cc:482] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:39.821161 23933 raft_consensus.cc:3037] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.821151 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b28ac3cbbd4b60a35e09ac35b2706f" candidate_uuid: "28f973828a74476d883c077bb307b13e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2bfdf251a884d44bd00f67c26c69df1" is_pre_election: true
I20260812 20:58:39.821237 23255 raft_consensus.cc:2454] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28f973828a74476d883c077bb307b13e in term 0.
I20260812 20:58:39.822098 23933 raft_consensus.cc:504] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.822263 23933 leader_election.cc:288] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [CANDIDATE]: Term 1 election: Requested vote from peers b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771), 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797)
I20260812 20:58:39.822448 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b28ac3cbbd4b60a35e09ac35b2706f" candidate_uuid: "28f973828a74476d883c077bb307b13e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2bfdf251a884d44bd00f67c26c69df1"
I20260812 20:58:39.822459 23510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91b28ac3cbbd4b60a35e09ac35b2706f" candidate_uuid: "28f973828a74476d883c077bb307b13e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395b85521bb4475c82d7665a33ff811e"
I20260812 20:58:39.822532 23255 raft_consensus.cc:3037] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.822552 23510 raft_consensus.cc:3037] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:39.823350 23255 raft_consensus.cc:2454] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28f973828a74476d883c077bb307b13e in term 1.
I20260812 20:58:39.823558 23640 leader_election.cc:302] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28f973828a74476d883c077bb307b13e, b2bfdf251a884d44bd00f67c26c69df1; no voters:
I20260812 20:58:39.823588 23510 raft_consensus.cc:2454] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28f973828a74476d883c077bb307b13e in term 1.
I20260812 20:58:39.823654 23933 raft_consensus.cc:2781] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:39.823865 23933 raft_consensus.cc:686] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 1 LEADER]: Becoming Leader. State: Replica: 28f973828a74476d883c077bb307b13e, State: Running, Role: LEADER
I20260812 20:58:39.823962 23933 consensus_queue.cc:237] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.825035 22938 catalog_manager.cc:5495] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e reported cstate change: term changed from 0 to 1, leader changed from <none> to 28f973828a74476d883c077bb307b13e (127.10.30.67). New cstate: current_term: 1 leader_uuid: "28f973828a74476d883c077bb307b13e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } health_report { overall_health: HEALTHY } } }
I20260812 20:58:39.860150 23910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:39.857165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41930 (local address 127.10.30.67:35191)
0812 20:58:39.857296 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:39.857298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:39.857310 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:39.857377 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:39.857378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:39.857415 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:39.857532 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:39.857720 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.858287 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.859216 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:39.859427 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:39.859515 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:39.859724 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:39.859870 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:39.859978 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:39.859998 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 20:58:39.860023 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 20:58:39.861640 23510 raft_consensus.cc:1261] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Refusing update from remote peer 28f973828a74476d883c077bb307b13e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:39.861757 23255 raft_consensus.cc:1261] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Refusing update from remote peer 28f973828a74476d883c077bb307b13e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:39.862177 23933 consensus_queue.cc:1035] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [LEADER]: Connected to new peer: Peer: permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:39.862416 24036 consensus_queue.cc:1035] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:39.867475 22938 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:39.867620 22938 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:39.868536 22938 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: Sending DeleteTablet for 3 replicas of tablet 91b28ac3cbbd4b60a35e09ac35b2706f
I20260812 20:58:39.868851 23729 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b28ac3cbbd4b60a35e09ac35b2706f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:41922
I20260812 20:58:39.868952 23213 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b28ac3cbbd4b60a35e09ac35b2706f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:54832
I20260812 20:58:39.869007 23962 tablet_replica.cc:330] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: stopping tablet replica
I20260812 20:58:39.869079 23962 raft_consensus.cc:2229] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:39.869109 23961 tablet_replica.cc:330] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: stopping tablet replica
I20260812 20:58:39.869195 23962 raft_consensus.cc:2258] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.869196 23961 raft_consensus.cc:2229] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:39.869176 23472 tablet_service.cc:1514] Processing DeleteTablet for tablet 91b28ac3cbbd4b60a35e09ac35b2706f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:39 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:42904
I20260812 20:58:39.869254 23961 raft_consensus.cc:2258] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.869284 23963 tablet_replica.cc:330] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: stopping tablet replica
I20260812 20:58:39.869349 23963 raft_consensus.cc:2229] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:39.869395 23963 raft_consensus.cc:2258] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:39.869792 23963 ts_tablet_manager.cc:1905] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.869959 23961 ts_tablet_manager.cc:1905] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.871893 23961 ts_tablet_manager.cc:1918] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:39.871982 23961 log.cc:1196] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/91b28ac3cbbd4b60a35e09ac35b2706f
I20260812 20:58:39.871958 23963 ts_tablet_manager.cc:1918] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:39.872028 23963 log.cc:1196] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/91b28ac3cbbd4b60a35e09ac35b2706f
I20260812 20:58:39.872249 23961 ts_tablet_manager.cc:1939] T 91b28ac3cbbd4b60a35e09ac35b2706f P b2bfdf251a884d44bd00f67c26c69df1: Deleting consensus metadata
I20260812 20:58:39.872289 23963 ts_tablet_manager.cc:1939] T 91b28ac3cbbd4b60a35e09ac35b2706f P 395b85521bb4475c82d7665a33ff811e: Deleting consensus metadata
I20260812 20:58:39.872864 23962 ts_tablet_manager.cc:1905] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:39.873077 22916 catalog_manager.cc:4841] TS 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797): tablet 91b28ac3cbbd4b60a35e09ac35b2706f (table test-table [id=a1032cfe6b074e37bcbb49d3a3d03116]) successfully deleted
I20260812 20:58:39.873289 22916 catalog_manager.cc:4841] TS b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771): tablet 91b28ac3cbbd4b60a35e09ac35b2706f (table test-table [id=a1032cfe6b074e37bcbb49d3a3d03116]) successfully deleted
I20260812 20:58:39.873454 22938 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:58:39.873657 22938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:58:39.874606 23962 ts_tablet_manager.cc:1918] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:58:39.874668 23962 log.cc:1196] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/91b28ac3cbbd4b60a35e09ac35b2706f
I20260812 20:58:39.874946 23962 ts_tablet_manager.cc:1939] T 91b28ac3cbbd4b60a35e09ac35b2706f P 28f973828a74476d883c077bb307b13e: Deleting consensus metadata
I20260812 20:58:39.875348 23729 tablet_service.cc:1467] Processing CreateTablet for tablet 82fe0d03780b40ddaea33a518f2ff643 (DEFAULT_TABLE table=test-table [id=f66172f6bea44f4487f46a0f5aae6ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.875478 23729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82fe0d03780b40ddaea33a518f2ff643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.875869 22920 catalog_manager.cc:4841] TS 28f973828a74476d883c077bb307b13e (127.10.30.67:35191): tablet 91b28ac3cbbd4b60a35e09ac35b2706f (table test-table [id=a1032cfe6b074e37bcbb49d3a3d03116]) successfully deleted
I20260812 20:58:39.876883 23925 tablet_bootstrap.cc:492] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: Bootstrap starting.
I20260812 20:58:39.877046 23213 tablet_service.cc:1467] Processing CreateTablet for tablet 82fe0d03780b40ddaea33a518f2ff643 (DEFAULT_TABLE table=test-table [id=f66172f6bea44f4487f46a0f5aae6ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.877200 23213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82fe0d03780b40ddaea33a518f2ff643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.877439 23925 tablet_bootstrap.cc:654] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.878785 23920 tablet_bootstrap.cc:492] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1: Bootstrap starting.
I20260812 20:58:39.879269 23920 tablet_bootstrap.cc:654] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.879288 23472 tablet_service.cc:1467] Processing CreateTablet for tablet 82fe0d03780b40ddaea33a518f2ff643 (DEFAULT_TABLE table=test-table [id=f66172f6bea44f4487f46a0f5aae6ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:58:39.879472 23472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82fe0d03780b40ddaea33a518f2ff643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:39.881230 23926 tablet_bootstrap.cc:492] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: Bootstrap starting.
I20260812 20:58:39.881625 23926 tablet_bootstrap.cc:654] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:39.882200 23925 tablet_bootstrap.cc:492] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: No bootstrap required, opened a new log
I20260812 20:58:39.882269 23925 ts_tablet_manager.cc:1397] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260812 20:58:39.882332 23926 tablet_bootstrap.cc:492] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: No bootstrap required, opened a new log
I20260812 20:58:39.882390 23926 ts_tablet_manager.cc:1397] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 20:58:39.882495 23925 raft_consensus.cc:348] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.882594 23925 raft_consensus.cc:374] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.882547 23926 raft_consensus.cc:348] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.882627 23925 raft_consensus.cc:729] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28f973828a74476d883c077bb307b13e, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.882627 23926 raft_consensus.cc:374] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.882655 23926 raft_consensus.cc:729] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395b85521bb4475c82d7665a33ff811e, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.882695 23925 consensus_queue.cc:260] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.882723 23926 consensus_queue.cc:260] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.882826 23925 ts_tablet_manager.cc:1428] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:39.882851 23926 ts_tablet_manager.cc:1428] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:39.889621 23920 tablet_bootstrap.cc:492] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1: No bootstrap required, opened a new log
I20260812 20:58:39.889720 23920 ts_tablet_manager.cc:1397] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20260812 20:58:39.889891 23920 raft_consensus.cc:348] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.889998 23920 raft_consensus.cc:374] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:39.890020 23920 raft_consensus.cc:729] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2bfdf251a884d44bd00f67c26c69df1, State: Initialized, Role: FOLLOWER
I20260812 20:58:39.890076 23920 consensus_queue.cc:260] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:39.890204 23920 ts_tablet_manager.cc:1428] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 20:58:40.189185 24010 raft_consensus.cc:482] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:58:40.189348 24010 raft_consensus.cc:504] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:40.189631 24010 leader_election.cc:288] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771), 28f973828a74476d883c077bb307b13e (127.10.30.67:35191)
I20260812 20:58:40.190078 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82fe0d03780b40ddaea33a518f2ff643" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2bfdf251a884d44bd00f67c26c69df1" is_pre_election: true
I20260812 20:58:40.190052 23776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82fe0d03780b40ddaea33a518f2ff643" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f973828a74476d883c077bb307b13e" is_pre_election: true
I20260812 20:58:40.190227 23776 raft_consensus.cc:2454] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 0.
I20260812 20:58:40.190227 23255 raft_consensus.cc:2454] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 0.
I20260812 20:58:40.190469 23389 leader_election.cc:302] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 395b85521bb4475c82d7665a33ff811e, b2bfdf251a884d44bd00f67c26c69df1; no voters:
I20260812 20:58:40.190630 24010 raft_consensus.cc:2781] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:58:40.190716 24010 raft_consensus.cc:482] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:58:40.190750 24010 raft_consensus.cc:3037] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:40.192013 24010 raft_consensus.cc:504] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:40.192265 24010 leader_election.cc:288] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 election: Requested vote from peers b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771), 28f973828a74476d883c077bb307b13e (127.10.30.67:35191)
I20260812 20:58:40.192525 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82fe0d03780b40ddaea33a518f2ff643" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2bfdf251a884d44bd00f67c26c69df1"
I20260812 20:58:40.192523 23776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82fe0d03780b40ddaea33a518f2ff643" candidate_uuid: "395b85521bb4475c82d7665a33ff811e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f973828a74476d883c077bb307b13e"
I20260812 20:58:40.192663 23776 raft_consensus.cc:3037] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:40.192668 23255 raft_consensus.cc:3037] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:40.193555 23255 raft_consensus.cc:2454] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 1.
I20260812 20:58:40.193586 23776 raft_consensus.cc:2454] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 395b85521bb4475c82d7665a33ff811e in term 1.
I20260812 20:58:40.193815 23389 leader_election.cc:302] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 395b85521bb4475c82d7665a33ff811e, b2bfdf251a884d44bd00f67c26c69df1; no voters:
I20260812 20:58:40.193941 24010 raft_consensus.cc:2781] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:40.194104 24010 raft_consensus.cc:686] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 1 LEADER]: Becoming Leader. State: Replica: 395b85521bb4475c82d7665a33ff811e, State: Running, Role: LEADER
I20260812 20:58:40.194165 24010 consensus_queue.cc:237] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } }
I20260812 20:58:40.194931 22938 catalog_manager.cc:5495] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e reported cstate change: term changed from 0 to 1, leader changed from <none> to 395b85521bb4475c82d7665a33ff811e (127.10.30.66). New cstate: current_term: 1 leader_uuid: "395b85521bb4475c82d7665a33ff811e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "395b85521bb4475c82d7665a33ff811e" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 36797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 } health_report { overall_health: UNKNOWN } } }
I20260812 20:58:40.245589 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:40.243111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.10.30.66:36797)
0812 20:58:40.243205 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:40.243207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:40.243214 (+ 7us) server_negotiation.cc:407] Connection header received
0812 20:58:40.243239 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:40.243239 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:40.243250 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:40.243316 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:58:40.243514 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:40.244054 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:40.244820 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:40.245038 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:40.245121 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:40.245266 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:58:40.245311 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:58:40.245376 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:40.245445 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 20:58:40.245472 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 20:58:40.249037 23776 raft_consensus.cc:1261] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Refusing update from remote peer 395b85521bb4475c82d7665a33ff811e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:40.249037 23255 raft_consensus.cc:1261] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Refusing update from remote peer 395b85521bb4475c82d7665a33ff811e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:58:40.249361 24060 consensus_queue.cc:1035] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28f973828a74476d883c077bb307b13e" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:40.249540 24066 consensus_queue.cc:1035] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2bfdf251a884d44bd00f67c26c69df1" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:58:40.263945 22950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:40.264145 22950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:58:40.264966 22950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a30e5e2591ce4436bfc545e3867fa4d8: Sending DeleteTablet for 3 replicas of tablet 82fe0d03780b40ddaea33a518f2ff643
I20260812 20:58:40.265271 23213 tablet_service.cc:1514] Processing DeleteTablet for tablet 82fe0d03780b40ddaea33a518f2ff643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:40 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:54832
I20260812 20:58:40.265328 23472 tablet_service.cc:1514] Processing DeleteTablet for tablet 82fe0d03780b40ddaea33a518f2ff643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:40 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:42904
I20260812 20:58:40.265301 23729 tablet_service.cc:1514] Processing DeleteTablet for tablet 82fe0d03780b40ddaea33a518f2ff643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:58:40 UTC) from {username='oryx', principal='oryx/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:41922
I20260812 20:58:40.265456 23961 tablet_replica.cc:330] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1: stopping tablet replica
I20260812 20:58:40.265456 23962 tablet_replica.cc:330] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: stopping tablet replica
I20260812 20:58:40.265527 23961 raft_consensus.cc:2229] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:40.265571 23961 raft_consensus.cc:2258] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:40.265563 23962 raft_consensus.cc:2229] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:58:40.265630 23962 raft_consensus.cc:2258] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:40.265715 23963 tablet_replica.cc:330] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: stopping tablet replica
I20260812 20:58:40.265798 23963 raft_consensus.cc:2229] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:58:40.265883 23963 raft_consensus.cc:2258] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:58:40.265995 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 23088
I20260812 20:58:40.266240 23961 ts_tablet_manager.cc:1905] T 82fe0d03780b40ddaea33a518f2ff643 P b2bfdf251a884d44bd00f67c26c69df1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:40.266819 23963 ts_tablet_manager.cc:1905] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:40.275643 23963 ts_tablet_manager.cc:1918] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:40.275758 23963 log.cc:1196] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/82fe0d03780b40ddaea33a518f2ff643
I20260812 20:58:40.276001 23963 ts_tablet_manager.cc:1939] T 82fe0d03780b40ddaea33a518f2ff643 P 395b85521bb4475c82d7665a33ff811e: Deleting consensus metadata
I20260812 20:58:40.276479 22916 catalog_manager.cc:4841] TS 395b85521bb4475c82d7665a33ff811e (127.10.30.66:36797): tablet 82fe0d03780b40ddaea33a518f2ff643 (table test-table [id=f66172f6bea44f4487f46a0f5aae6ee3]) successfully deleted
I20260812 20:58:40.278592 23962 ts_tablet_manager.cc:1905] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:58:40.280562 23962 ts_tablet_manager.cc:1918] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 20:58:40.280686 23962 log.cc:1196] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/82fe0d03780b40ddaea33a518f2ff643
I20260812 20:58:40.281081 23962 ts_tablet_manager.cc:1939] T 82fe0d03780b40ddaea33a518f2ff643 P 28f973828a74476d883c077bb307b13e: Deleting consensus metadata
I20260812 20:58:40.281594 22920 catalog_manager.cc:4841] TS 28f973828a74476d883c077bb307b13e (127.10.30.67:35191): tablet 82fe0d03780b40ddaea33a518f2ff643 (table test-table [id=f66172f6bea44f4487f46a0f5aae6ee3]) successfully deleted
W20260812 20:58:40.289165 22916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:32771 (error 108)
I20260812 20:58:40.289392 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 23361
I20260812 20:58:40.307644 24076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:40.306025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:32771 (local address 127.0.0.1:54854)
0812 20:58:40.307473 (+ 1448us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:40.307571 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:32771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1414,"thread_start_us":1364,"threads_started":1}
W20260812 20:58:40.307842 22916 catalog_manager.cc:4584] TS b2bfdf251a884d44bd00f67c26c69df1 (127.10.30.65:32771): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82fe0d03780b40ddaea33a518f2ff643: Network error: Client connection negotiation failed: client connection to 127.10.30.65:32771: connect: Connection refused (error 111)
I20260812 20:58:40.316352 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 23612
I20260812 20:58:40.341737 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 22885
2026-08-12T20:58:40Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3756 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:40 dist-test-slave-h3ft krb5kdc[24080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:40 dist-test-slave-h3ft krb5kdc[24080](info): set up 2 sockets
Aug 12 20:58:40 dist-test-slave-h3ft krb5kdc[24080](info): commencing operation
krb5kdc: starting...
W20260812 20:58:41.716935 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:41 dist-test-slave-h3ft krb5kdc[24080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:41.874668 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44463
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:37065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:44463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:41.975797 24101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:41.976100 24101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:41.976145 24101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:41.977461 24101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:41.977531 24101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:41.977557 24101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:41.977587 24101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:41.977619 24101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:41.979331 24101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:44463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:41.979673 24101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:41.979956 24101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:41.985641 24112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:41.985657 24115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:41.985667 24113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:41.986115 24101 server_base.cc:1034] running on GCE node
I20260812 20:58:41.986480 24101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:41.986845 24101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:41.987998 24101 hybrid_clock.cc:648] HybridClock initialized: now 1786568321987979 us; error 46 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T20:58:42Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1653 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:58:42 dist-test-slave-h3ft krb5kdc[24124](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:58:42 dist-test-slave-h3ft krb5kdc[24124](info): set up 2 sockets
Aug 12 20:58:42 dist-test-slave-h3ft krb5kdc[24124](info): commencing operation
krb5kdc: starting...
W20260812 20:58:43.361163 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:58:43 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:58:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:58:43.515515 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43005
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:43005
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:43.613507 24145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:43.613816 24145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:43.613859 24145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:43.615561 24145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:43.615651 24145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:43.615679 24145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:43.615710 24145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:43.615742 24145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:43.617549 24145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:43005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:43.617901 24145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:43.618201 24145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:43.624217 24154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:43.624459 24145 server_base.cc:1034] running on GCE node
W20260812 20:58:43.624221 24157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:43.624248 24153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:43.625142 24145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:43.625562 24145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:43.626753 24145 hybrid_clock.cc:648] HybridClock initialized: now 1786568323626730 us; error 49 us; skew 500 ppm
Aug 12 20:58:43 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:43.630025 24145 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:43.630616 24145 webserver.cc:460] Webserver started at http://127.10.30.126:41133/ using document root <none> and password file <none>
I20260812 20:58:43.630939 24145 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:43.631067 24145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:43.631253 24145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:43.632588 24145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5"
format_stamp: "Formatted at 2026-08-12 20:58:43 on dist-test-slave-h3ft"
server_key: "7261b08423c3ffdfd3d9cd145fc9adc4"
server_key_iv: "7edfd308793e7038a97eed362b1ea38f"
server_key_version: "encryptionkey@0"
I20260812 20:58:43.633023 24145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5"
format_stamp: "Formatted at 2026-08-12 20:58:43 on dist-test-slave-h3ft"
server_key: "7261b08423c3ffdfd3d9cd145fc9adc4"
server_key_iv: "7edfd308793e7038a97eed362b1ea38f"
server_key_version: "encryptionkey@0"
I20260812 20:58:43.634684 24145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 20:58:43.635813 24169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:43.636096 24145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:43.636214 24145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5"
format_stamp: "Formatted at 2026-08-12 20:58:43 on dist-test-slave-h3ft"
server_key: "7261b08423c3ffdfd3d9cd145fc9adc4"
server_key_iv: "7edfd308793e7038a97eed362b1ea38f"
server_key_version: "encryptionkey@0"
I20260812 20:58:43.636310 24145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:43.664830 24145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:43.667769 24145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:43.667987 24145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:43.673720 24145 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:43005
I20260812 20:58:43.673806 24268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:43005 every 8 connection(s)
I20260812 20:58:43.674252 24145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:43.675371 24269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:58:43.678300 24269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Bootstrap starting.
I20260812 20:58:43.679142 24269 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Neither blocks nor log segments found. Creating new log.
I20260812 20:58:43.679526 24269 log.cc:824] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:43.680509 24269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: No bootstrap required, opened a new log
I20260812 20:58:43.682433 24269 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } }
I20260812 20:58:43.682621 24269 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:58:43.682646 24269 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e48a8ff7b2430eb63aefad6a9ed3b5, State: Initialized, Role: FOLLOWER
I20260812 20:58:43.682854 24269 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } }
I20260812 20:58:43.682935 24269 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:43.682982 24269 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:43.683068 24269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:58:43.683845 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 24145
I20260812 20:58:43.683869 24269 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } }
I20260812 20:58:43.683993 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:58:43.683992 24269 leader_election.cc:302] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7e48a8ff7b2430eb63aefad6a9ed3b5; no voters:
I20260812 20:58:43.684240 24269 leader_election.cc:288] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:58:43.684244 10361 external_mini_cluster.cc:1428] Setting key 584b9aae09e9d5f5f9f3e73e75e387ee
I20260812 20:58:43.684325 24272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:58:43.684576 24272 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 1 LEADER]: Becoming Leader. State: Replica: c7e48a8ff7b2430eb63aefad6a9ed3b5, State: Running, Role: LEADER
I20260812 20:58:43.684756 24272 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } }
I20260812 20:58:43.684587 24269 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:43.685377 24276 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7e48a8ff7b2430eb63aefad6a9ed3b5. Latest consensus state: current_term: 1 leader_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } } }
I20260812 20:58:43.685461 24276 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:43.685580 24273 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } } }
I20260812 20:58:43.685653 24273 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:43.686143 24287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:43.686874 24287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:43.688802 24287 catalog_manager.cc:1347] Generated new cluster ID: 608c823cebff4417b92df4977d72fb8e
I20260812 20:58:43.688865 24287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 20:58:43 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:43.698114 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:43.684819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45486 (local address 127.10.30.126:43005)
0812 20:58:43.685072 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:43.685083 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:43.685179 (+ 96us) server_negotiation.cc:407] Connection header received
0812 20:58:43.685781 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:43.685793 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:43.685902 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:43.686177 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:43.687139 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:43.688630 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:43.689820 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:43.690503 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:43.690647 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:43.693891 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:43.693896 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:43.693896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:43.693911 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:43.696110 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:43.696590 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:43.696593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:43.696593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:43.696732 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:43.696972 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:43.696972 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:43.696973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:43.697339 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:43.697504 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:43.697673 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 20:58:43.697830 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":102,"threads_started":1}
I20260812 20:58:43.711134 24287 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:58:43.712087 24287 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:43.718336 24287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Generated new TSK 0
I20260812 20:58:43.718636 24287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:58:43.763269 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43005
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:43.870491 24317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:43.870848 24317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:43.870882 24317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:43.872318 24317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:43.872373 24317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:43.872406 24317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:43.874089 24317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:43.874401 24317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:43.874720 24317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:43.880816 24331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:43.880894 24335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:43.880882 24317 server_base.cc:1034] running on GCE node
W20260812 20:58:43.880827 24337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:43.881281 24317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:43.881599 24317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:43.882757 24317 hybrid_clock.cc:648] HybridClock initialized: now 1786568323882740 us; error 44 us; skew 500 ppm
Aug 12 20:58:43 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:43.886304 24317 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:58:43.886935 24317 webserver.cc:460] Webserver started at http://127.10.30.65:34167/ using document root <none> and password file <none>
I20260812 20:58:43.887311 24317 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:43.887388 24317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:43.887563 24317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:43.888827 24317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "58a3f78937004e64a7a0b0832ac1a0b5"
format_stamp: "Formatted at 2026-08-12 20:58:43 on dist-test-slave-h3ft"
server_key: "53b714b003805e990e642eca96713c09"
server_key_iv: "8d804aa6baab0345810d8bcc81685f6d"
server_key_version: "encryptionkey@0"
I20260812 20:58:43.889259 24317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "58a3f78937004e64a7a0b0832ac1a0b5"
format_stamp: "Formatted at 2026-08-12 20:58:43 on dist-test-slave-h3ft"
server_key: "53b714b003805e990e642eca96713c09"
server_key_iv: "8d804aa6baab0345810d8bcc81685f6d"
server_key_version: "encryptionkey@0"
I20260812 20:58:43.890830 24317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260812 20:58:43.891780 24354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:43.891965 24317 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:43.892095 24317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "58a3f78937004e64a7a0b0832ac1a0b5"
format_stamp: "Formatted at 2026-08-12 20:58:43 on dist-test-slave-h3ft"
server_key: "53b714b003805e990e642eca96713c09"
server_key_iv: "8d804aa6baab0345810d8bcc81685f6d"
server_key_version: "encryptionkey@0"
I20260812 20:58:43.892184 24317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:43.900539 24317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:43.903414 24317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:43.903609 24317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:43.903916 24317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:43.904320 24317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:43.904383 24317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:43.904429 24317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:43.904460 24317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:43.912501 24317 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:46115
I20260812 20:58:43.912608 24556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:46115 every 8 connection(s)
I20260812 20:58:43.913030 24317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
Aug 12 20:58:43 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:43.921676 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 24317
I20260812 20:58:43.921828 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:58:43.922070 10361 external_mini_cluster.cc:1428] Setting key 799d3e9a29aa74b3244e04e0bc5b1623
I20260812 20:58:43.926344 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:43.914374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:56247 (local address 127.10.30.126:43005)
0812 20:58:43.914454 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:43.914460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:43.914641 (+ 181us) server_negotiation.cc:407] Connection header received
0812 20:58:43.915268 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:43.915270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:43.915290 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:43.915371 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:43.916671 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:43.917357 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:43.918541 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:43.918777 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:43.918888 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:43.922043 (+ 3155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:43.922045 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:43.922046 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:43.922057 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:43.924174 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:43.924918 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:43.924920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:43.924920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:43.924992 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:43.925358 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:43.925359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:43.925359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:43.925525 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:43.925619 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:43.926058 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 20:58:43.926193 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 20:58:43.926447 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:43.914218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:56247)
0812 20:58:43.914429 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:43.914482 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:43.915140 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:43.915517 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:43.915522 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:43.916299 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:43.916542 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:43.916548 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:43.917478 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:43.917478 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:43.918432 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:43.918435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:43.918937 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:43.918938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:43.919156 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:43.919869 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:43.919879 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:43.921814 (+ 1935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:43.924286 (+ 2472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:43.924302 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:43.924305 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:43.924756 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:43.925078 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:43.925079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:43.925080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:43.925279 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:43.925619 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:43.925631 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:43.925887 (+ 256us) client_negotiation.cc:769] Sending connection context
0812 20:58:43.926000 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 20:58:43.926180 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":117,"threads_started":1}
I20260812 20:58:43.927145 24558 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43005
I20260812 20:58:43.927315 24558 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:43.927589 24558 heartbeater.cc:511] Master 127.10.30.126:43005 requested a full tablet report, sending...
I20260812 20:58:43.928386 24205 ts_manager.cc:194] Registered new tserver with Master: 58a3f78937004e64a7a0b0832ac1a0b5 (127.10.30.65:46115)
I20260812 20:58:43.929185 24205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:56247
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:58:43.959702 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43005
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:44.060235 24569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:44.060518 24569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:44.060547 24569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:44.061976 24569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:44.062041 24569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:44.062073 24569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:44.064144 24569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:44.064484 24569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:44.064777 24569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:44.071587 24580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.071599 24578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.071614 24577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:44.071841 24569 server_base.cc:1034] running on GCE node
I20260812 20:58:44.072315 24569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:44.072698 24569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:44.073922 24569 hybrid_clock.cc:648] HybridClock initialized: now 1786568324073904 us; error 65 us; skew 500 ppm
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568324, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:44.077744 24569 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:58:44.078513 24569 webserver.cc:460] Webserver started at http://127.10.30.66:40089/ using document root <none> and password file <none>
I20260812 20:58:44.078864 24569 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:44.078953 24569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:44.079205 24569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:44.080672 24569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "c21a871c496b4290947159ff2291b1ae"
format_stamp: "Formatted at 2026-08-12 20:58:44 on dist-test-slave-h3ft"
server_key: "6ebd2a19cc6db61f43c03f381c8e81f0"
server_key_iv: "8f59eeb78c9f16957d1772ed3c32da5d"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.081167 24569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "c21a871c496b4290947159ff2291b1ae"
format_stamp: "Formatted at 2026-08-12 20:58:44 on dist-test-slave-h3ft"
server_key: "6ebd2a19cc6db61f43c03f381c8e81f0"
server_key_iv: "8f59eeb78c9f16957d1772ed3c32da5d"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.083093 24569 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 20:58:44.084121 24594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.084352 24569 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:44.084486 24569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "c21a871c496b4290947159ff2291b1ae"
format_stamp: "Formatted at 2026-08-12 20:58:44 on dist-test-slave-h3ft"
server_key: "6ebd2a19cc6db61f43c03f381c8e81f0"
server_key_iv: "8f59eeb78c9f16957d1772ed3c32da5d"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.084582 24569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:44.101174 24569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:44.104399 24569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:44.104635 24569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:44.105012 24569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:44.105428 24569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:44.105496 24569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.105537 24569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:44.105585 24569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.114362 24569 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:38225
I20260812 20:58:44.114552 24825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:38225 every 8 connection(s)
I20260812 20:58:44.114938 24569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:44.118027 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 24569
I20260812 20:58:44.118156 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:58:44.118423 10361 external_mini_cluster.cc:1428] Setting key 44970033e6479c3569ea151236a4abda
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568324, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:44.128338 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:44.116053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:55709 (local address 127.10.30.126:43005)
0812 20:58:44.116188 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:44.116191 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:44.116394 (+ 203us) server_negotiation.cc:407] Connection header received
0812 20:58:44.117130 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:44.117132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:44.117148 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:44.117215 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:44.118636 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.119297 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.120433 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.120653 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.120772 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.124008 (+ 3236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:44.124011 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:44.124012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:44.124023 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:44.126232 (+ 2209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:44.126782 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:44.126784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:44.126785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:44.126870 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:44.127338 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:44.127340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:44.127341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:44.127554 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:44.127643 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:44.128047 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 20:58:44.128203 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 20:58:44.128530 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:44.115917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:55709)
0812 20:58:44.116208 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:44.116275 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:44.116983 (+ 708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:44.117314 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:44.117319 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:44.118210 (+ 891us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:44.118509 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.118519 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.119410 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.119411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.120326 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.120328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.120784 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.120785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.120945 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.121736 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:44.121749 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:44.123870 (+ 2121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:44.126356 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:44.126368 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:44.126371 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:44.126682 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:44.126994 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:44.126995 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:44.126996 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:44.127247 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:44.127673 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:44.127682 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:44.127872 (+ 190us) client_negotiation.cc:769] Sending connection context
0812 20:58:44.127991 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 20:58:44.128238 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":149,"threads_started":1}
I20260812 20:58:44.129310 24828 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43005
I20260812 20:58:44.129474 24828 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:44.129726 24828 heartbeater.cc:511] Master 127.10.30.126:43005 requested a full tablet report, sending...
I20260812 20:58:44.130303 24205 ts_manager.cc:194] Registered new tserver with Master: c21a871c496b4290947159ff2291b1ae (127.10.30.66:38225)
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
I20260812 20:58:44.130937 24205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:55709
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:58:44.160792 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43005
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:44.267294 24838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:44.267609 24838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:44.267656 24838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:44.269006 24838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:44.269078 24838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:44.269129 24838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:44.270788 24838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:44.271150 24838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:44.271442 24838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:44.277819 24850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.277900 24846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.277819 24848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:44.278203 24838 server_base.cc:1034] running on GCE node
I20260812 20:58:44.278439 24838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:44.278735 24838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:44.279953 24838 hybrid_clock.cc:648] HybridClock initialized: now 1786568324279936 us; error 32 us; skew 500 ppm
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568324, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:44.282912 24838 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:58:44.283491 24838 webserver.cc:460] Webserver started at http://127.10.30.67:36009/ using document root <none> and password file <none>
I20260812 20:58:44.283726 24838 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:44.283771 24838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:44.283875 24838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:44.285177 24838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "54c8e6ba2f124ae19821b3e4af3da208"
format_stamp: "Formatted at 2026-08-12 20:58:44 on dist-test-slave-h3ft"
server_key: "049f4ab1a9476f8da6a0c6d8a3c8ced2"
server_key_iv: "0ead05d1e22a4a19f88494b1c1431a25"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.285667 24838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "54c8e6ba2f124ae19821b3e4af3da208"
format_stamp: "Formatted at 2026-08-12 20:58:44 on dist-test-slave-h3ft"
server_key: "049f4ab1a9476f8da6a0c6d8a3c8ced2"
server_key_iv: "0ead05d1e22a4a19f88494b1c1431a25"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.287351 24838 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 20:58:44.288170 24860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.288409 24838 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:44.288594 24838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "54c8e6ba2f124ae19821b3e4af3da208"
format_stamp: "Formatted at 2026-08-12 20:58:44 on dist-test-slave-h3ft"
server_key: "049f4ab1a9476f8da6a0c6d8a3c8ced2"
server_key_iv: "0ead05d1e22a4a19f88494b1c1431a25"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.288662 24838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:44.302769 24838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:44.305418 24838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:44.305572 24838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:44.305851 24838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:44.306252 24838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:44.306288 24838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.306315 24838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:44.306363 24838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.314085 24838 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:37863
I20260812 20:58:44.314241 25074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:37863 every 8 connection(s)
I20260812 20:58:44.314612 24838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:58:44.319401 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 24838
I20260812 20:58:44.319515 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:58:44.319733 10361 external_mini_cluster.cc:1428] Setting key 2eb5609b836d45a78c8aecf289e2e4f8
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568324, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:58:44.326594 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:44.315731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:42595 (local address 127.10.30.126:43005)
0812 20:58:44.315834 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:44.315837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:44.316100 (+ 263us) server_negotiation.cc:407] Connection header received
0812 20:58:44.316716 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:44.316718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:44.316733 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:44.316805 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:44.318027 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.318605 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.319903 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.320198 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.320277 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.323276 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:44.323279 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:44.323279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:44.323289 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:44.324930 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:44.325438 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:44.325439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:44.325440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:44.325507 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:44.325795 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:44.325796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:44.325797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:44.325969 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:44.326055 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:44.326413 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 20:58:44.326508 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 20:58:44.326838 25077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:44.315668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:42595)
0812 20:58:44.315887 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:44.315933 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:44.316585 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:44.316908 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:44.316913 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:44.317647 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:44.317904 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.317910 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.318703 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.318704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.319820 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.319823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.320320 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.320322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.320498 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.321332 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:44.321343 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:44.323159 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:58:44.325066 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:44.325076 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:44.325078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:44.325354 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:44.325574 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:58:44.325575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:58:44.325575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:58:44.325699 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:58:44.326058 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:58:44.326065 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:58:44.326228 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 20:58:44.326334 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 20:58:44.326523 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":117,"threads_started":1}
I20260812 20:58:44.327558 25075 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43005
I20260812 20:58:44.327701 25075 heartbeater.cc:464] Registering TS with master...
I20260812 20:58:44.327940 25075 heartbeater.cc:511] Master 127.10.30.126:43005 requested a full tablet report, sending...
I20260812 20:58:44.328498 24205 ts_manager.cc:194] Registered new tserver with Master: 54c8e6ba2f124ae19821b3e4af3da208 (127.10.30.67:37863)
I20260812 20:58:44.328912 24205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:42595
I20260812 20:58:44.332231 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab.
Entry for principal oryx/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab.
WARNING: no policy specified for oryx/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab.
Entry for principal oryx/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab.
WARNING: no policy specified for oryx/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab.
Entry for principal oryx/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab.
I20260812 20:58:44.442958 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 24317
I20260812 20:58:44.460105 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 24569
I20260812 20:58:44.484475 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 24838
I20260812 20:58:44.498219 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 24145
I20260812 20:58:44.513069 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43005
--webserver_interface=127.10.30.126
--webserver_port=41133
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:43005
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:58:44.612809 25087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:44.613178 25087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:44.613230 25087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:44.614879 25087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:44.614966 25087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:44.615020 25087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:44.615058 25087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:44.615099 25087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:44.617137 25087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:43005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=41133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:44.617511 25087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:44.617822 25087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:44.624344 25104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:44.624534 25087 server_base.cc:1034] running on GCE node
W20260812 20:58:44.624344 25101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.624385 25098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:44.625205 25087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:44.625615 25087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:44.626874 25087 hybrid_clock.cc:648] HybridClock initialized: now 1786568324626788 us; error 82 us; skew 500 ppm
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568324, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:44.630365 25087 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:58:44.631059 25087 webserver.cc:460] Webserver started at http://127.10.30.126:41133/ using document root <none> and password file <none>
I20260812 20:58:44.631341 25087 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:44.631431 25087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:44.633149 25087 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:44.634002 25114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.634332 25087 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:44.634475 25087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5"
format_stamp: "Formatted at 2026-08-12 20:58:43 on dist-test-slave-h3ft"
server_key: "7261b08423c3ffdfd3d9cd145fc9adc4"
server_key_iv: "7edfd308793e7038a97eed362b1ea38f"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.634941 25087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:44.644955 25087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:44.647760 25087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:44.647965 25087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:44.653131 25087 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:43005
I20260812 20:58:44.653168 25213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:43005 every 8 connection(s)
I20260812 20:58:44.653841 25087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:58:44.655591 25214 sys_catalog.cc:263] Verifying existing consensus state
I20260812 20:58:44.656482 25214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Bootstrap starting.
I20260812 20:58:44.660853 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 25087
I20260812 20:58:44.661283 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:46115
--local_ip_for_outbound_sockets=127.10.30.65
--tserver_master_addrs=127.10.30.126:43005
--webserver_port=34167
--webserver_interface=127.10.30.65
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.30.65
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 20:58:44.669745 25214 log.cc:824] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Log is configured to *not* fsync() on all Append() calls
I20260812 20:58:44.672070 25214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 20:58:44.672436 25214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Bootstrap complete.
I20260812 20:58:44.675299 25214 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } }
I20260812 20:58:44.675566 25214 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e48a8ff7b2430eb63aefad6a9ed3b5, State: Initialized, Role: FOLLOWER
I20260812 20:58:44.675772 25214 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } }
I20260812 20:58:44.675860 25214 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:58:44.675930 25214 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:58:44.675982 25214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 20:58:44.677300 25214 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } }
I20260812 20:58:44.677469 25214 leader_election.cc:302] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7e48a8ff7b2430eb63aefad6a9ed3b5; no voters:
I20260812 20:58:44.677729 25214 leader_election.cc:288] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 20:58:44.677778 25228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 20:58:44.677961 25228 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [term 2 LEADER]: Becoming Leader. State: Replica: c7e48a8ff7b2430eb63aefad6a9ed3b5, State: Running, Role: LEADER
I20260812 20:58:44.678140 25214 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:58:44.678128 25228 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } }
I20260812 20:58:44.678686 25229 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } } }
I20260812 20:58:44.678790 25229 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:44.679093 25230 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7e48a8ff7b2430eb63aefad6a9ed3b5. Latest consensus state: current_term: 2 leader_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7e48a8ff7b2430eb63aefad6a9ed3b5" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43005 } } }
I20260812 20:58:44.679185 25230 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5 [sys.catalog]: This master's current role is: LEADER
I20260812 20:58:44.679306 25237 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:58:44.680243 25237 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:58:44.680850 25237 catalog_manager.cc:1259] Loaded cluster ID: 608c823cebff4417b92df4977d72fb8e
I20260812 20:58:44.680895 25237 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:58:44.681802 25237 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:58:44.682024 25237 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c7e48a8ff7b2430eb63aefad6a9ed3b5: Loaded TSK: 0
I20260812 20:58:44.682268 25237 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 20:58:44.774364 25224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:44.774696 25224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:44.774740 25224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:44.776211 25224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:44.776299 25224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:44.776351 25224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:58:44.778156 25224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.65.keytab
--principal=oryx/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:46115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=34167
--tserver_master_addrs=127.10.30.126:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:44.778491 25224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:44.778827 25224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:44.785169 25266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.785179 25270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.785192 25265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:44.785676 25224 server_base.cc:1034] running on GCE node
I20260812 20:58:44.785916 25224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:44.786269 25224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:44.787459 25224 hybrid_clock.cc:648] HybridClock initialized: now 1786568324787438 us; error 38 us; skew 500 ppm
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568324, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:44.791164 25224 init.cc:377] Logged in from keytab as oryx/127.10.30.65@KRBTEST.COM (short username oryx)
I20260812 20:58:44.791757 25224 webserver.cc:460] Webserver started at http://127.10.30.65:34167/ using document root <none> and password file <none>
I20260812 20:58:44.792080 25224 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:44.792200 25224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:44.794119 25224 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:44.794967 25285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.795214 25224 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:44.795351 25224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "58a3f78937004e64a7a0b0832ac1a0b5"
format_stamp: "Formatted at 2026-08-12 20:58:43 on dist-test-slave-h3ft"
server_key: "53b714b003805e990e642eca96713c09"
server_key_iv: "8d804aa6baab0345810d8bcc81685f6d"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.795849 25224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:44.808262 25224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:44.811328 25224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:44.811530 25224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:44.811863 25224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:44.812252 25224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:44.812310 25224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.812369 25224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:44.812410 25224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.820376 25224 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:46115
I20260812 20:58:44.820422 25508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:46115 every 8 connection(s)
I20260812 20:58:44.820894 25224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:58:44.829973 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 25224
I20260812 20:58:44.830436 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:38225
--local_ip_for_outbound_sockets=127.10.30.66
--tserver_master_addrs=127.10.30.126:43005
--webserver_port=40089
--webserver_interface=127.10.30.66
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.30.66
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:44.837813 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:44.821900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:43931)
0812 20:58:44.822164 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:44.822228 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:44.822885 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:44.827960 (+ 5075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:44.827965 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:44.828839 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:44.829119 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.829126 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.831162 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.831165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.832681 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.832687 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.833527 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.833528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.833698 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.834439 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:44.834450 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:44.837495 (+ 3045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":108,"threads_started":1}
W20260812 20:58:44.837854 25517 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:44.821979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:43931 (local address 127.10.30.126:43005)
0812 20:58:44.827247 (+ 5268us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:44.827265 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:44.827371 (+ 106us) server_negotiation.cc:407] Connection header received
0812 20:58:44.827562 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:44.827573 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:44.827653 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:44.827865 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:44.829312 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.830927 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.832841 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.833382 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.833545 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.837685 (+ 4140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:43931: BlockingRecv error: recv got EOF from 127.10.30.65:43931 (error 108)
Metrics: {"server-negotiator.queue_time_us":5169,"thread_start_us":124,"threads_started":1}
W20260812 20:58:44.838514 25509 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:43005 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.30.126:43005: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:44.847752 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:44.838857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:45605)
0812 20:58:44.838915 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:44.838928 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:44.838976 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:44.839189 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:44.839190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:44.839350 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:44.839414 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.839416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.840142 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.840143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.840684 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.840686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.841094 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.841095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.841174 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.841707 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:44.841712 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:44.847650 (+ 5938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 20:58:44.848719 25517 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:44.838900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:45605 (local address 127.10.30.126:43005)
0812 20:58:44.838942 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:44.838944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:44.838955 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:44.839088 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:44.839089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:44.839105 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:44.839184 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:44.839503 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.840052 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.840784 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.840992 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.841094 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.847855 (+ 6761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:45605: BlockingRecv error: recv got EOF from 127.10.30.65:45605 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:44.855590 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:44.848252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:54919)
0812 20:58:44.848350 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:44.848364 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:44.848455 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:44.849043 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:44.849045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:44.849226 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:44.849291 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.849294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.850178 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.850180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.851167 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.851171 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.851652 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.851653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.851717 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.852260 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:44.852266 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:44.855490 (+ 3224us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 20:58:44.855690 25517 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:44.848357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:54919 (local address 127.10.30.126:43005)
0812 20:58:44.848847 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:44.848849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:44.848861 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:44.848895 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:44.848896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:44.848911 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:44.848974 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:44.849395 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.850073 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.851276 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.851578 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.851655 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.855609 (+ 3954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:54919: BlockingRecv error: recv got EOF from 127.10.30.65:54919 (error 108)
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":221,"threads_started":1}
W20260812 20:58:44.855782 25509 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 20:58:44.936590 25518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:44.936923 25518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:44.936971 25518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:44.938426 25518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:44.938501 25518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:44.938553 25518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:58:44.940375 25518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.66.keytab
--principal=oryx/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:38225
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=40089
--tserver_master_addrs=127.10.30.126:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:44.940726 25518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:44.941043 25518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:44.947330 25541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.947350 25537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:44.947381 25534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:44.947741 25518 server_base.cc:1034] running on GCE node
I20260812 20:58:44.947973 25518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:44.948292 25518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:44.949487 25518 hybrid_clock.cc:648] HybridClock initialized: now 1786568324949448 us; error 78 us; skew 500 ppm
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568324, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:44.953065 25518 init.cc:377] Logged in from keytab as oryx/127.10.30.66@KRBTEST.COM (short username oryx)
I20260812 20:58:44.953626 25518 webserver.cc:460] Webserver started at http://127.10.30.66:40089/ using document root <none> and password file <none>
I20260812 20:58:44.953902 25518 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:44.953969 25518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:44.955864 25518 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:58:44.956667 25555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.956857 25518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:44.956983 25518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "c21a871c496b4290947159ff2291b1ae"
format_stamp: "Formatted at 2026-08-12 20:58:44 on dist-test-slave-h3ft"
server_key: "6ebd2a19cc6db61f43c03f381c8e81f0"
server_key_iv: "8f59eeb78c9f16957d1772ed3c32da5d"
server_key_version: "encryptionkey@0"
I20260812 20:58:44.957463 25518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:44.980851 25518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:44.983783 25518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:44.983994 25518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:44.984272 25518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:44.984690 25518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:44.984730 25518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.984755 25518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:44.984804 25518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:44.992435 25518 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:38225
I20260812 20:58:44.992609 25754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:38225 every 8 connection(s)
I20260812 20:58:44.993007 25518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:58:45.000406 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 25518
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:45.000957 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:37863
--local_ip_for_outbound_sockets=127.10.30.67
--tserver_master_addrs=127.10.30.126:43005
--webserver_port=36009
--webserver_interface=127.10.30.67
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.30.67
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 20:58:44 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 20:58:45.002784 25517 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:44.994091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:51695 (local address 127.10.30.126:43005)
0812 20:58:44.994171 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:44.994174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:44.994491 (+ 317us) server_negotiation.cc:407] Connection header received
0812 20:58:44.995123 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:44.995124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:44.995151 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:44.995220 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:44.996382 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.996995 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.998144 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.998354 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.998429 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.002711 (+ 4282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:51695: BlockingRecv error: recv got EOF from 127.10.30.66:51695 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 20:58:45.002851 25765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:44.994087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:51695)
0812 20:58:44.994278 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:44.994331 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:44.994947 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:44.995313 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:44.995317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:44.996033 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:44.996275 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.996281 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.997138 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.997139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.998024 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:44.998027 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:44.998456 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:44.998457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:44.998593 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:44.999309 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:44.999319 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:45.002578 (+ 3259us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
W20260812 20:58:45.003187 25756 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:43005 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.30.126:43005: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:45.009517 25765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:45.003518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:35313)
0812 20:58:45.003610 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:45.003624 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:45.003680 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:45.003831 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:45.003832 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:45.003986 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:45.004048 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.004051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.004783 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.004784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.005637 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.005642 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.006092 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.006094 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.006172 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.006710 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:45.006717 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:45.009393 (+ 2676us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76}
W20260812 20:58:45.009588 25517 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:45.003566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:35313 (local address 127.10.30.126:43005)
0812 20:58:45.003616 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:45.003618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:45.003661 (+ 43us) server_negotiation.cc:407] Connection header received
0812 20:58:45.003753 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:45.003754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:45.003765 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:45.003822 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:45.004152 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.004681 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.005756 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.005996 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.006079 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.009528 (+ 3449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:35313: BlockingRecv error: recv got EOF from 127.10.30.66:35313 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:45.016285 25765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:45.010533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:37503)
0812 20:58:45.010610 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:45.010624 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:45.010706 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:45.010873 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:45.010875 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:45.011136 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:45.011183 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.011186 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.011890 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.011892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.012418 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.012420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.012812 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.012813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.012873 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.013567 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:45.013572 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:45.016171 (+ 2599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 20:58:45.016361 25517 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:45.010637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:37503 (local address 127.10.30.126:43005)
0812 20:58:45.010710 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:45.010713 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:45.010724 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:45.010777 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:45.010778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:45.010797 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:45.010867 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:45.011272 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.011798 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.012518 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.012731 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.012815 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.016284 (+ 3469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:37503: BlockingRecv error: recv got EOF from 127.10.30.66:37503 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 20:58:45.016783 25756 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 20:58:45.108904 25766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:45.109244 25766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:45.109297 25766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:45.110684 25766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:58:45.110749 25766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:45.110781 25766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:58:45.112509 25766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/krb5kdc/oryx_127.10.30.67.keytab
--principal=oryx/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:37863
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=36009
--tserver_master_addrs=127.10.30.126:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:45.112803 25766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:45.113080 25766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:45.119587 25775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:45.119590 25780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:45.119590 25776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:45.120321 25766 server_base.cc:1034] running on GCE node
I20260812 20:58:45.120625 25766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:45.120994 25766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:45.122217 25766 hybrid_clock.cc:648] HybridClock initialized: now 1786568325122202 us; error 51 us; skew 500 ppm
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568325, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:58:45.125684 25766 init.cc:377] Logged in from keytab as oryx/127.10.30.67@KRBTEST.COM (short username oryx)
I20260812 20:58:45.126283 25766 webserver.cc:460] Webserver started at http://127.10.30.67:36009/ using document root <none> and password file <none>
I20260812 20:58:45.126570 25766 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:45.126674 25766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:45.128571 25766 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:45.129577 25794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:45.129859 25766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:58:45.129990 25766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "54c8e6ba2f124ae19821b3e4af3da208"
format_stamp: "Formatted at 2026-08-12 20:58:44 on dist-test-slave-h3ft"
server_key: "049f4ab1a9476f8da6a0c6d8a3c8ced2"
server_key_iv: "0ead05d1e22a4a19f88494b1c1431a25"
server_key_version: "encryptionkey@0"
I20260812 20:58:45.130486 25766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:45.149641 25766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:45.152558 25766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:45.152726 25766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:45.152989 25766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:58:45.153396 25766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:58:45.153434 25766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:45.153469 25766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:58:45.153515 25766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:45.160917 25766 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:37863
I20260812 20:58:45.161072 25986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:37863 every 8 connection(s)
I20260812 20:58:45.161432 25766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:45.170583 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 25766
W20260812 20:58:45.170626 25517 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:45.162405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:59263 (local address 127.10.30.126:43005)
0812 20:58:45.162502 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:45.162506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:45.162787 (+ 281us) server_negotiation.cc:407] Connection header received
0812 20:58:45.163510 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:45.163511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:45.163525 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:45.163580 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:45.164688 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.165286 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.166496 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.166702 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.166772 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.170546 (+ 3774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:59263: BlockingRecv error: recv got EOF from 127.10.30.67:59263 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 20:58:45.170732 25989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:45.162373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:59263)
0812 20:58:45.162632 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:45.162679 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:45.163392 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:45.163653 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:45.163657 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:45.164339 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:45.164590 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.164596 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.165413 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.165414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.166381 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.166384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.166798 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.166799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.166940 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.167634 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:45.167644 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:45.170436 (+ 2792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":136,"threads_started":1}
W20260812 20:58:45.171137 25987 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:43005 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.30.126:43005: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:45.176993 25989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:45.171494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:41341)
0812 20:58:45.171548 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:45.171565 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:45.171635 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:45.171852 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:45.171853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:45.172020 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:45.172090 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.172092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.172889 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.172890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.173442 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.173444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.173907 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.173909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.174004 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.174587 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:45.174594 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:45.176923 (+ 2329us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 20:58:45.177188 25521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:45.171547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:41341 (local address 127.10.30.126:43005)
0812 20:58:45.171630 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:45.171632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:45.171642 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:45.171709 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:45.171710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:45.171725 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:45.171827 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:45.172184 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.172772 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.173555 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.173782 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.173890 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.177083 (+ 3193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:41341: BlockingRecv error: recv got EOF from 127.10.30.67:41341 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 20:58:45.180086 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:45.171441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45492 (local address 127.10.30.126:43005)
0812 20:58:45.171505 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:45.171508 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:45.171615 (+ 107us) server_negotiation.cc:407] Connection header received
0812 20:58:45.171707 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:45.171708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:45.171721 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:45.171790 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:45.172497 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.172989 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.173855 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.174060 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.174139 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.175785 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:58:45.175791 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:58:45.175792 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:58:45.175884 (+ 92us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:58:45.178267 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:45.178693 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:45.178697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:45.178697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:45.178818 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:58:45.179066 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:58:45.179067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:58:45.179068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:58:45.179454 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:58:45.179709 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 20:58:45.179819 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 20:58:45.179954 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:45.182940 25989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:45.177514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:50819)
0812 20:58:45.177573 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:45.177604 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:45.177653 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:45.177801 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:45.177802 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:45.177964 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:45.178004 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.178005 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.178929 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.178930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.179663 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.179666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.180121 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.180122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.180182 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.180625 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:45.180631 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:45.182824 (+ 2193us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 20:58:45.182988 25521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:45.177600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:50819 (local address 127.10.30.126:43005)
0812 20:58:45.177662 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:45.177665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:45.177691 (+ 26us) server_negotiation.cc:407] Connection header received
0812 20:58:45.177713 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:45.177714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:45.177732 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:45.177795 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:45.178091 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.178800 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.179789 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.180059 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.180124 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.182917 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:50819: BlockingRecv error: recv got EOF from 127.10.30.67:50819 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260812 20:58:45.183207 25987 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:45 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:45.862865 25992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:45.856399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:45445)
0812 20:58:45.856661 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:45.856677 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:45.856804 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:45.857033 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:45.857034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:45.857248 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:45.857319 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.857321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.858174 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.858175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.858790 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:45.858792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.859402 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.859403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:45.859452 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.860288 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:45.860295 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:45.862780 (+ 2485us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":174,"threads_started":1}
W20260812 20:58:45.863123 25994 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:45.856572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:45445 (local address 127.10.30.126:43005)
0812 20:58:45.856770 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:45.856772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:45.856787 (+ 15us) server_negotiation.cc:407] Connection header received
0812 20:58:45.856893 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:45.856894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:45.856908 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:45.857001 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:45.857454 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.858062 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.858899 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:45.859185 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:45.859401 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:45.862918 (+ 3517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:45445: BlockingRecv error: recv got EOF from 127.10.30.65:45445 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":115,"threads_started":1}
Aug 12 20:58:46 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:46 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:46.023932 25998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:46.017444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:38139)
0812 20:58:46.017709 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:46.017730 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:46.017874 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:46.018142 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:46.018143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:46.018449 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:46.018537 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:46.018540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.019570 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.019571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:46.020212 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:46.020214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.020605 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.020605 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:46.020653 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:46.021290 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:46.021296 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:46.023833 (+ 2537us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":146,"threads_started":1}
W20260812 20:58:46.024084 25994 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:46.017621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:38139 (local address 127.10.30.126:43005)
0812 20:58:46.017732 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:46.017735 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:46.017842 (+ 107us) server_negotiation.cc:407] Connection header received
0812 20:58:46.018000 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:46.018001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:46.018016 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:46.018084 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:46.018785 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.019472 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.020314 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.020522 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.020585 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:46.023983 (+ 3398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:38139: BlockingRecv error: recv got EOF from 127.10.30.66:38139 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 20:58:46 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:46 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:46.189625 25999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:46.183818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:48295)
0812 20:58:46.184090 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:46.184108 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:46.184235 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:46.184433 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:46.184434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:46.184727 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:46.184802 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:46.184805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.185521 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.185522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:46.186119 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:46.186122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.186522 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.186523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:46.186589 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:46.187362 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:46.187367 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:46.189488 (+ 2121us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":123,"threads_started":1}
W20260812 20:58:46.189687 25994 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:46.183984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:48295 (local address 127.10.30.126:43005)
0812 20:58:46.184089 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:46.184092 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:46.184200 (+ 108us) server_negotiation.cc:407] Connection header received
0812 20:58:46.184325 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:46.184327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:46.184350 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:46.184423 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:46.184899 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.185418 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.186215 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.186425 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.186519 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:46.189616 (+ 3097us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:48295: BlockingRecv error: recv got EOF from 127.10.30.67:48295 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 20:58:46 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:46 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:46.870342 26002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:46.863645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:47443)
0812 20:58:46.863875 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:46.863955 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:46.864079 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:46.864323 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:46.864324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:46.864564 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:46.864646 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:46.864648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.865981 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.865983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:46.866672 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:46.866675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.867216 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.867217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:46.867285 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:46.867995 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:46.868002 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:46.870260 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":107,"threads_started":1}
W20260812 20:58:46.870594 26003 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:46.863823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:47443 (local address 127.10.30.126:43005)
0812 20:58:46.864053 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:46.864055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:46.864073 (+ 18us) server_negotiation.cc:407] Connection header received
0812 20:58:46.864163 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:46.864164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:46.864179 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:46.864266 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:46.864790 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.865811 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.866784 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:46.867099 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:46.867210 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:46.870485 (+ 3275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:47443: BlockingRecv error: recv got EOF from 127.10.30.65:47443 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":121,"threads_started":1}
Aug 12 20:58:47 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:47 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:47.035809 26004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:47.024718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:58279)
0812 20:58:47.024901 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:47.024914 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:47.024991 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:47.025177 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:47.025178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:47.025387 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:47.025461 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:47.025463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.026257 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.026258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:47.026855 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:47.026857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.027311 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.027312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:47.027364 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:47.032676 (+ 5312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:47.032683 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:47.035694 (+ 3011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":108,"threads_started":1}
W20260812 20:58:47.036170 26003 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:47.024800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:58279 (local address 127.10.30.126:43005)
0812 20:58:47.024889 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:47.024891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:47.024978 (+ 87us) server_negotiation.cc:407] Connection header received
0812 20:58:47.025054 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:47.025055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:47.025094 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:47.025167 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:47.025586 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.026145 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.026962 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.027226 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.027298 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:47.036078 (+ 8780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:58279: BlockingRecv error: recv got EOF from 127.10.30.66:58279 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 20:58:47 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:47 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:47.195703 26005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:47.190438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:37879)
0812 20:58:47.190693 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:47.190716 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:47.190827 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:47.190981 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:47.190982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:47.191234 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:47.191291 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:47.191293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.192022 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.192023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:47.192589 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:47.192591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.192975 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.192976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:47.193044 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:47.193616 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:47.193622 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:47.195595 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":89,"threads_started":1}
W20260812 20:58:47.195744 26003 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:47.190718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:37879 (local address 127.10.30.126:43005)
0812 20:58:47.190809 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:47.190812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:47.190823 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:47.190890 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:47.190891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:47.190907 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:47.190975 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:47.191382 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.191923 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.192682 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.192894 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.192973 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:47.195677 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:37879: BlockingRecv error: recv got EOF from 127.10.30.67:37879 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 20:58:47 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:47 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:47.877416 26006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:47.871097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:48991)
0812 20:58:47.871307 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:47.871325 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:47.871442 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:47.871627 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:47.871628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:47.871880 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:47.871960 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:47.871962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.872830 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.872832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:47.873448 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:47.873451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.873875 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.873876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:47.873961 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:47.874611 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:47.874616 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:47.877336 (+ 2720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":96,"threads_started":1}
W20260812 20:58:47.877807 26007 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:47.871225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:48991 (local address 127.10.30.126:43005)
0812 20:58:47.871430 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:47.871432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:47.871447 (+ 15us) server_negotiation.cc:407] Connection header received
0812 20:58:47.871508 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:47.871509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:47.871523 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:47.871603 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:47.872121 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.872687 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.873538 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:47.873747 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:47.873813 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:47.877648 (+ 3835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:48991: BlockingRecv error: recv got EOF from 127.10.30.65:48991 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":107,"threads_started":1}
Aug 12 20:58:48 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:48 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:48.042863 26008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:48.036635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:55565)
0812 20:58:48.036837 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:48.036851 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:48.036932 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:48.037176 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:48.037177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:48.037404 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:48.037483 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:48.037485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.038337 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.038337 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:48.038993 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:48.039033 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.039473 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.039474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:48.039526 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:48.040110 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:48.040116 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:48.042790 (+ 2674us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":126,"threads_started":1}
W20260812 20:58:48.043229 26007 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:48.036769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:55565 (local address 127.10.30.126:43005)
0812 20:58:48.036866 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:48.036868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:48.037000 (+ 132us) server_negotiation.cc:407] Connection header received
0812 20:58:48.037043 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:48.037044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:48.037060 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:48.037150 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:48.037624 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.038242 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.039137 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.039390 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.039460 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:48.043136 (+ 3676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:55565: BlockingRecv error: recv got EOF from 127.10.30.66:55565 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 20:58:48 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:48 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:48.203402 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:48.196570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:45345)
0812 20:58:48.196827 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:48.196843 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:48.196936 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:48.197137 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:48.197138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:48.197385 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:48.197481 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:48.197484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.198297 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.198298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:48.199041 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:48.199043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.199445 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.199446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:48.199521 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:48.200278 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:48.200283 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:48.203311 (+ 3028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":178,"threads_started":1}
W20260812 20:58:48.203569 26007 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:48.196791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:45345 (local address 127.10.30.126:43005)
0812 20:58:48.196867 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:48.196871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:48.196908 (+ 37us) server_negotiation.cc:407] Connection header received
0812 20:58:48.197011 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:48.197013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:48.197034 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:48.197108 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:48.197577 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.198184 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.199134 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.199346 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.199425 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:48.203465 (+ 4040us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:45345: BlockingRecv error: recv got EOF from 127.10.30.67:45345 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 20:58:48 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:48 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:48.889475 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:48.878156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:55309)
0812 20:58:48.878371 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:48.878385 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:48.878466 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:48.878749 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:48.878750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:48.878972 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:48.879132 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:48.879134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.880038 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.880039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:48.880626 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:48.880628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.881119 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.881120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:48.881179 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:48.886700 (+ 5521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:48.886709 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:48.889385 (+ 2676us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":133,"threads_started":1}
W20260812 20:58:48.889673 26014 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:48.878204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:55309 (local address 127.10.30.126:43005)
0812 20:58:48.878383 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:48.878385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:48.878456 (+ 71us) server_negotiation.cc:407] Connection header received
0812 20:58:48.878583 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:48.878584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:48.878601 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:48.878687 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:48.879228 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.879924 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.880735 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:48.881015 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:48.881093 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:48.889535 (+ 8442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:55309: BlockingRecv error: recv got EOF from 127.10.30.65:55309 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":111,"threads_started":1}
Aug 12 20:58:49 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:49 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:49.050170 26015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:49.043797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:56375)
0812 20:58:49.044044 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:49.044068 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:49.044165 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:49.044417 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:49.044418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:49.044648 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:49.044718 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:49.044720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.045517 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.045518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:49.046132 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:49.046134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.046694 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.046695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:49.046762 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:49.047597 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:49.047604 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:49.050089 (+ 2485us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":123,"threads_started":1}
W20260812 20:58:49.050339 26014 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:49.043989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:56375 (local address 127.10.30.126:43005)
0812 20:58:49.044092 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:49.044095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:49.044214 (+ 119us) server_negotiation.cc:407] Connection header received
0812 20:58:49.044261 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:49.044262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:49.044278 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:49.044365 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:49.044810 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.045415 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.046264 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.046478 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.046559 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:49.050266 (+ 3707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:56375: BlockingRecv error: recv got EOF from 127.10.30.66:56375 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 12 20:58:49 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:49 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:49.212482 26016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:49.204106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:42879)
0812 20:58:49.204304 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:49.204324 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:49.204442 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:49.204658 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:49.204659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:49.204982 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:49.205078 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:49.205082 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.206254 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.206256 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:49.207491 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:49.207497 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.208221 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.208224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:49.208312 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:49.209096 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:49.209103 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:49.212332 (+ 3229us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":100,"threads_started":1}
W20260812 20:58:49.212591 26014 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:49.204186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:42879 (local address 127.10.30.126:43005)
0812 20:58:49.204254 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:49.204256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:49.204425 (+ 169us) server_negotiation.cc:407] Connection header received
0812 20:58:49.204534 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:49.204535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:49.204552 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:49.204625 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:49.205198 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.206107 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.207630 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.208097 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.208211 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:49.212461 (+ 4250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:42879: BlockingRecv error: recv got EOF from 127.10.30.67:42879 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 20:58:49 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:49 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:49.896149 26018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:49.890301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:59021)
0812 20:58:49.890519 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:49.890535 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:49.890639 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:49.890884 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:49.890886 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:49.891212 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:49.891305 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:49.891308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.892140 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.892141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:49.892733 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:49.892735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.893154 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.893154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:49.893201 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:49.893777 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:49.893782 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:49.896026 (+ 2244us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":145,"threads_started":1}
W20260812 20:58:49.896219 26019 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:49.890507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:59021 (local address 127.10.30.126:43005)
0812 20:58:49.890650 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:49.890652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:49.890664 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:58:49.890724 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:49.890725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:49.890744 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:49.890828 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:49.891432 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.892048 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.892837 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:49.893074 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:49.893143 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:49.896136 (+ 2993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:59021: BlockingRecv error: recv got EOF from 127.10.30.65:59021 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
Aug 12 20:58:50 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:50 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:50.058806 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:50.051301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:46771)
0812 20:58:50.051467 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:50.051481 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:50.051553 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:50.051989 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:50.051992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:50.052472 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:50.052552 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:50.052556 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.053876 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.053878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:50.054473 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:50.054475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.055296 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.055298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:50.055396 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:50.056120 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:50.056126 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:50.058698 (+ 2572us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
W20260812 20:58:50.058936 26019 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:50.051462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:46771 (local address 127.10.30.126:43005)
0812 20:58:50.051555 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:50.051557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:50.051567 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:50.051813 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:50.051815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:50.051842 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:50.051928 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:50.052717 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.053702 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.054612 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.055134 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.055289 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:50.058852 (+ 3563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:46771: BlockingRecv error: recv got EOF from 127.10.30.66:46771 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 20:58:50 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:50 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:50.219147 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:50.213360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:54955)
0812 20:58:50.213589 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:50.213601 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:50.213672 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:50.213822 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:50.213823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:50.214155 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:50.214226 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:50.214228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.214968 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.214969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:50.215590 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:50.215592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.215994 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.215995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:50.216060 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:50.216645 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:50.216650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:50.219053 (+ 2403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":153,"threads_started":1}
W20260812 20:58:50.219367 26019 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:50.213413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:54955 (local address 127.10.30.126:43005)
0812 20:58:50.213507 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:50.213510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:50.213667 (+ 157us) server_negotiation.cc:407] Connection header received
0812 20:58:50.213736 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:50.213737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:50.213753 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:50.213799 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:50.214316 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.214878 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.215680 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.215877 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.215940 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:50.219289 (+ 3349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:54955: BlockingRecv error: recv got EOF from 127.10.30.67:54955 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 20:58:50 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:50 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:50.903770 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:50.896898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:42269)
0812 20:58:50.897154 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:50.897171 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:50.897270 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:50.897529 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:50.897531 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:50.897788 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:50.897865 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:50.897867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.898768 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.898769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:50.899689 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:50.899695 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.900190 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.900191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:50.900290 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:50.900923 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:50.900929 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:50.903648 (+ 2719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":123,"threads_started":1}
W20260812 20:58:50.903855 26030 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:50.897065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:42269 (local address 127.10.30.126:43005)
0812 20:58:50.897268 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:50.897270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:50.897284 (+ 14us) server_negotiation.cc:407] Connection header received
0812 20:58:50.897362 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:50.897363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:50.897377 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:50.897461 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:50.897971 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.898629 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.899797 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:50.900029 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:50.900101 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:50.903753 (+ 3652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:42269: BlockingRecv error: recv got EOF from 127.10.30.65:42269 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":122,"threads_started":1}
Aug 12 20:58:51 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:51 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:51.066956 26031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:51.059754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:55707)
0812 20:58:51.060000 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:51.060021 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:51.060112 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:51.060377 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:51.060378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:51.060632 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:51.060707 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:51.060710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.061766 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.061767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:51.062613 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:51.062616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.063225 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.063226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:51.063285 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:51.064155 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:51.064164 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:51.066847 (+ 2683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":172,"threads_started":1}
W20260812 20:58:51.067131 26030 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:51.059907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:55707 (local address 127.10.30.126:43005)
0812 20:58:51.060025 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:51.060027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:51.060177 (+ 150us) server_negotiation.cc:407] Connection header received
0812 20:58:51.060228 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:51.060228 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:51.060241 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:51.060303 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:51.060865 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.061590 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.062791 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.063055 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.063203 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:51.066988 (+ 3785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:55707: BlockingRecv error: recv got EOF from 127.10.30.66:55707 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 20:58:51 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:51 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:51.225768 26032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:51.219827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:49119)
0812 20:58:51.220000 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:51.220015 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:51.220124 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:51.220317 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:51.220319 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:51.220549 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:51.220613 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:51.220616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.221400 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.221402 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:51.222031 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:51.222033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.222451 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.222452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:51.222520 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:51.223266 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:51.223271 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:51.225636 (+ 2365us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
W20260812 20:58:51.225890 26030 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:51.220035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:49119 (local address 127.10.30.126:43005)
0812 20:58:51.220152 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:51.220155 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:51.220168 (+ 13us) server_negotiation.cc:407] Connection header received
0812 20:58:51.220200 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:51.220202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:51.220222 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:51.220304 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:51.220712 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.221292 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.222134 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.222352 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.222436 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:51.225785 (+ 3349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:49119: BlockingRecv error: recv got EOF from 127.10.30.67:49119 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 20:58:51 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:51 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:51.911293 26033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:51.904569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:34631)
0812 20:58:51.904796 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:51.904809 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:51.904873 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:51.905155 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:51.905156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:51.905370 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:51.905433 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:51.905435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.906297 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.906298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:51.906991 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:51.906994 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.907558 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.907559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:51.907613 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:51.908445 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:51.908450 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:51.911208 (+ 2758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":147,"threads_started":1}
W20260812 20:58:51.911593 26035 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:51.904748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:34631 (local address 127.10.30.126:43005)
0812 20:58:51.904944 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:51.904946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:51.904960 (+ 14us) server_negotiation.cc:407] Connection header received
0812 20:58:51.904996 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:51.904997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:51.905012 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:51.905114 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:51.905534 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.906193 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.907191 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:51.907435 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:51.907552 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:51.911461 (+ 3909us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:34631: BlockingRecv error: recv got EOF from 127.10.30.65:34631 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":109,"threads_started":1}
Aug 12 20:58:52 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:52 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:52.080374 26036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:52.067827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:53437)
0812 20:58:52.068053 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:52.068068 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:52.068164 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:52.068430 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:52.068431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:52.068660 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:52.068739 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:52.068742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.069817 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.069818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:52.070685 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:52.070689 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.071319 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.071320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:52.071381 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:52.076950 (+ 5569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:52.076959 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:52.080289 (+ 3330us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":153,"threads_started":1}
W20260812 20:58:52.080673 26035 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:52.067958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:53437 (local address 127.10.30.126:43005)
0812 20:58:52.068077 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:52.068080 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:52.068166 (+ 86us) server_negotiation.cc:407] Connection header received
0812 20:58:52.068248 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:52.068249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:52.068262 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:52.068363 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:52.068870 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.069577 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.070797 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.071196 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.071274 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:52.080571 (+ 9297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:53437: BlockingRecv error: recv got EOF from 127.10.30.66:53437 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 12 20:58:52 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:52 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:52.232904 26037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:52.226625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:43949)
0812 20:58:52.226818 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:52.226833 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:52.226929 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:52.227145 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:52.227147 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:52.227385 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:52.227460 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:52.227462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.228317 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.228318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:52.228898 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:52.228901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.229354 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.229355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:52.229420 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:52.230393 (+ 973us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:52.230400 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:52.232821 (+ 2421us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":113,"threads_started":1}
W20260812 20:58:52.233115 26035 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:52.226818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:43949 (local address 127.10.30.126:43005)
0812 20:58:52.226972 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:52.226975 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:52.226985 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:52.227045 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:52.227046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:52.227062 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:52.227134 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:52.227542 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.228117 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.229019 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.229233 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.229363 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:52.232992 (+ 3629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:43949: BlockingRecv error: recv got EOF from 127.10.30.67:43949 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 20:58:52 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:52 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:52.918197 26038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:52.911987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:44581)
0812 20:58:52.912392 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:52.912412 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:52.912508 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:52.912785 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:52.912787 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:52.912984 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:52.913042 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:52.913043 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.913866 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.913867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:52.914472 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:52.914474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.914892 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.914893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:52.914944 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:52.915585 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:52.915590 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:52.918115 (+ 2525us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":116,"threads_started":1}
W20260812 20:58:52.918409 26040 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:52.912355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:44581 (local address 127.10.30.126:43005)
0812 20:58:52.912578 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:52.912581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:52.912592 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:52.912627 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:52.912628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:52.912641 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:52.912719 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:52.913168 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.913760 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.914573 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:52.914804 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:52.914870 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:52.918320 (+ 3450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:44581: BlockingRecv error: recv got EOF from 127.10.30.65:44581 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":116,"threads_started":1}
Aug 12 20:58:53 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:53 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:53.086978 26046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:53.080999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:58285)
0812 20:58:53.081179 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:53.081190 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:53.081245 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:53.081442 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:53.081443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:53.081644 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:53.081717 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:53.081719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.082651 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.082652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:53.083341 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:53.083344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.083767 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.083769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:53.083829 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:53.084436 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:53.084441 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:53.086908 (+ 2467us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":107,"threads_started":1}
W20260812 20:58:53.087316 26040 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:53.081115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:58285 (local address 127.10.30.126:43005)
0812 20:58:53.081214 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:53.081216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:53.081237 (+ 21us) server_negotiation.cc:407] Connection header received
0812 20:58:53.081324 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:53.081325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:53.081342 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:53.081413 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:53.081828 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.082544 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.083441 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.083652 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.083725 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:53.087216 (+ 3491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:58285: BlockingRecv error: recv got EOF from 127.10.30.66:58285 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 20:58:53 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:53 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:53.240571 26047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:53.233652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:52177)
0812 20:58:53.233973 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:53.233990 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:53.234120 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:53.234314 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:53.234315 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:53.234612 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:53.234684 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:53.234686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.235756 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.235757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:53.236370 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:53.236371 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.236787 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.236788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:53.236837 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:53.237472 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:53.237477 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:53.240462 (+ 2985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":193,"threads_started":1}
W20260812 20:58:53.240877 26040 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:53.233836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:52177 (local address 127.10.30.126:43005)
0812 20:58:53.233949 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:53.233952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:53.234088 (+ 136us) server_negotiation.cc:407] Connection header received
0812 20:58:53.234207 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:53.234208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:53.234228 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:53.234305 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:53.234866 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.235621 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.236480 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.236698 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.236776 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:53.240765 (+ 3989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:52177: BlockingRecv error: recv got EOF from 127.10.30.67:52177 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 20:58:53 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:53 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:53.924750 26048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:53.918872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:39897)
0812 20:58:53.919153 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:53.919167 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:53.919255 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:53.919473 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:53.919474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:53.919750 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:53.919817 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:53.919819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.920586 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.920587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:53.921181 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:53.921182 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.921578 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.921579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:53.921623 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:53.922232 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:53.922237 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:53.924611 (+ 2374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":174,"threads_started":1}
W20260812 20:58:53.924806 26049 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:53.919063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:39897 (local address 127.10.30.126:43005)
0812 20:58:53.919229 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:53.919231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:53.919242 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:58:53.919330 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:53.919331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:53.919345 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:53.919421 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:53.919924 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.920490 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.921275 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:53.921490 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:53.921555 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:53.924719 (+ 3164us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:39897: BlockingRecv error: recv got EOF from 127.10.30.65:39897 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
Aug 12 20:58:54 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:54 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:54.094344 26051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:54.087816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:45941)
0812 20:58:54.088119 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:54.088135 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:54.088314 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:54.088560 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:54.088561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:54.088811 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:54.088893 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:54.088895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.089774 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.089776 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:54.090410 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:54.090412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.090850 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.090851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:54.090916 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:54.091599 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:54.091604 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:54.094223 (+ 2619us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":164,"threads_started":1}
W20260812 20:58:54.094444 26049 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:54.087967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:45941 (local address 127.10.30.126:43005)
0812 20:58:54.088099 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:54.088103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:54.088290 (+ 187us) server_negotiation.cc:407] Connection header received
0812 20:58:54.088437 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:54.088438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:54.088459 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:54.088530 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:54.088986 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.089577 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.090522 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.090757 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.090849 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:54.094336 (+ 3487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:45941: BlockingRecv error: recv got EOF from 127.10.30.66:45941 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 12 20:58:54 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:54 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:54.247085 26052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:54.241275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:60291)
0812 20:58:54.241526 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:54.241540 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:54.241662 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:54.241933 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:54.241934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:54.242188 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:54.242257 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:54.242260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.242991 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.242993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:54.243685 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:54.243688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.244111 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.244112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:54.244168 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:54.244732 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:54.244737 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:54.246921 (+ 2184us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":167,"threads_started":1}
W20260812 20:58:54.247203 26049 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:54.241321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:60291 (local address 127.10.30.126:43005)
0812 20:58:54.241415 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:54.241418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:54.241630 (+ 212us) server_negotiation.cc:407] Connection header received
0812 20:58:54.241756 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:54.241756 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:54.241775 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:54.241850 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:54.242338 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.242884 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.243783 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.244017 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.244081 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:54.247120 (+ 3039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:60291: BlockingRecv error: recv got EOF from 127.10.30.67:60291 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 20:58:54 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:54 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:54.932951 26053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:54.925629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:48775)
0812 20:58:54.926104 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:54.926129 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:54.926231 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:54.926412 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:54.926413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:54.926646 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:54.926737 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:54.926739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.927759 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.927760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:54.928572 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:54.928575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.929500 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.929502 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:54.929583 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:54.930501 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:54.930508 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:54.932869 (+ 2361us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":271,"threads_started":1}
W20260812 20:58:54.933238 26056 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:54.925910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:48775 (local address 127.10.30.126:43005)
0812 20:58:54.926087 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:54.926089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:54.926255 (+ 166us) server_negotiation.cc:407] Connection header received
0812 20:58:54.926295 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:54.926296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:54.926310 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:54.926387 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:54.926840 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.927612 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.928727 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:54.929095 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:54.929480 (+ 385us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:54.933099 (+ 3619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:48775: BlockingRecv error: recv got EOF from 127.10.30.65:48775 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":78,"threads_started":1}
Aug 12 20:58:55 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:55 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:55.101603 26057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:55.095202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:38585)
0812 20:58:55.095472 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:55.095487 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:55.095619 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:55.095818 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:55.095819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:55.096081 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:55.096151 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:55.096153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.097106 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.097107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:55.097739 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:55.097741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.098173 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.098174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:55.098239 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:55.099139 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:55.099146 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:55.101522 (+ 2376us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":129,"threads_started":1}
W20260812 20:58:55.101827 26056 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:55.095341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:38585 (local address 127.10.30.126:43005)
0812 20:58:55.095456 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:55.095459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:55.095586 (+ 127us) server_negotiation.cc:407] Connection header received
0812 20:58:55.095713 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:55.095714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:55.095730 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:55.095809 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:55.096249 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.096925 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.097842 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.098071 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.098173 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:55.101745 (+ 3572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:38585: BlockingRecv error: recv got EOF from 127.10.30.66:38585 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 20:58:55 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:55 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:55.254007 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:55.247922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:52975)
0812 20:58:55.248161 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:55.248203 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:55.248285 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:55.248495 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:55.248496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:55.248814 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:55.248902 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:55.248911 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.249693 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.249694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:55.250309 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:55.250311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.250767 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.250769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:55.250828 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:55.251624 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:55.251629 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:55.253911 (+ 2282us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":108,"threads_started":1}
W20260812 20:58:55.254222 26056 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:55.248194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:52975 (local address 127.10.30.126:43005)
0812 20:58:55.248270 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:55.248272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:55.248288 (+ 16us) server_negotiation.cc:407] Connection header received
0812 20:58:55.248354 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:55.248355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:55.248376 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:55.248450 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:55.249017 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.249590 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.250430 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.250642 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.250733 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:55.254112 (+ 3379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:52975: BlockingRecv error: recv got EOF from 127.10.30.67:52975 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 20:58:55 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:55 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:55.940676 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:55.933717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:54343)
0812 20:58:55.933907 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:55.933928 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:55.934033 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:55.934426 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:55.934428 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:55.934695 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:55.934767 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:55.934770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.935729 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.935730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:55.936505 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:55.936509 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.937152 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.937153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:55.937226 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:55.938021 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:55.938057 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:55.940577 (+ 2520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":117,"threads_started":1}
W20260812 20:58:55.940892 26064 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:55.933848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:54343 (local address 127.10.30.126:43005)
0812 20:58:55.934042 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:55.934044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:55.934091 (+ 47us) server_negotiation.cc:407] Connection header received
0812 20:58:55.934125 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:55.934126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:55.934139 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:55.934205 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:55.934950 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.935635 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.936618 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:55.937032 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:55.937131 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:55.940778 (+ 3647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:54343: BlockingRecv error: recv got EOF from 127.10.30.65:54343 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":120,"threads_started":1}
Aug 12 20:58:56 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:56 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:56.109287 26066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:56.102307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:59525)
0812 20:58:56.102695 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:56.102712 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:56.102832 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:56.103157 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:56.103159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:56.103434 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:56.103500 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:56.103502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.104593 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.104594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:56.105249 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:56.105251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.105703 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.105704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:56.105773 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:56.106453 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:56.106459 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:56.109164 (+ 2705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":163,"threads_started":1}
W20260812 20:58:56.109354 26064 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:56.102454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:59525 (local address 127.10.30.126:43005)
0812 20:58:56.102674 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:56.102677 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:56.102806 (+ 129us) server_negotiation.cc:407] Connection header received
0812 20:58:56.103041 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:56.103042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:56.103062 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:56.103143 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:56.103597 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.104457 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.105356 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.105614 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.105703 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:56.109277 (+ 3574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:59525: BlockingRecv error: recv got EOF from 127.10.30.66:59525 (error 108)
Metrics: {"server-negotiator.queue_time_us":173}
Aug 12 20:58:56 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:56 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:56.261479 26068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:56.254722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:47057)
0812 20:58:56.254979 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:56.254995 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:56.255118 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:56.255326 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:56.255327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:56.255581 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:56.255645 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:56.255647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.256473 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.256475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:56.257287 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:56.257291 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.257827 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.257829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:56.257939 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:56.258532 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:56.258538 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:56.261378 (+ 2840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":133,"threads_started":1}
W20260812 20:58:56.261711 26064 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:56.254878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:47057 (local address 127.10.30.126:43005)
0812 20:58:56.254985 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:56.254988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:56.255090 (+ 102us) server_negotiation.cc:407] Connection header received
0812 20:58:56.255199 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:56.255200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:56.255220 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:56.255315 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:56.255736 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.256352 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.257383 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.257711 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.257778 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:56.261610 (+ 3832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:47057: BlockingRecv error: recv got EOF from 127.10.30.67:47057 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 20:58:56 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:56 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:56.947177 26070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:56.941257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:42989)
0812 20:58:56.941477 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:56.941491 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:56.941575 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:56.941735 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:56.941736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:56.941975 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:56.942042 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:56.942044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.942930 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.942931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:56.943598 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:56.943600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.944025 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.944026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:56.944093 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:56.944773 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:56.944778 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:56.947064 (+ 2286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":124,"threads_started":1}
W20260812 20:58:56.947296 26071 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:56.941364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:42989 (local address 127.10.30.126:43005)
0812 20:58:56.941492 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:56.941495 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:56.941552 (+ 57us) server_negotiation.cc:407] Connection header received
0812 20:58:56.941637 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:56.941638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:56.941652 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:56.941711 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:56.942159 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.942761 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.943703 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:56.943927 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:56.943997 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:56.947204 (+ 3207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:42989: BlockingRecv error: recv got EOF from 127.10.30.65:42989 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
Aug 12 20:58:57 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:57 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:57.120144 26072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:57.110060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:36885)
0812 20:58:57.110243 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:57.110258 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:57.110355 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:57.110505 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:57.110506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:57.110739 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:57.110809 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:57.110811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.111744 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.111745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:57.112375 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:57.112377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.112815 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.112816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:57.112864 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:57.117563 (+ 4699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:57.117571 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:57.120061 (+ 2490us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":107,"threads_started":1}
W20260812 20:58:57.120314 26071 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:57.110260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:36885 (local address 127.10.30.126:43005)
0812 20:58:57.110359 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:57.110361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:57.110384 (+ 23us) server_negotiation.cc:407] Connection header received
0812 20:58:57.110411 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:57.110412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:57.110427 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:57.110481 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:57.110921 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.111633 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.112486 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.112737 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.112800 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:57.120218 (+ 7418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:36885: BlockingRecv error: recv got EOF from 127.10.30.66:36885 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 20:58:57 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:57 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:57.267590 26074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:57.262102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:44071)
0812 20:58:57.262322 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:57.262335 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:57.262427 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:57.262583 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:57.262584 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:57.262812 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:57.262883 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:57.262885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.263696 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.263697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:57.264313 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:57.264315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.264690 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.264691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:57.264746 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:57.265344 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:57.265349 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:57.267514 (+ 2165us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":113,"threads_started":1}
W20260812 20:58:57.267738 26071 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:57.262169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:44071 (local address 127.10.30.126:43005)
0812 20:58:57.262253 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:57.262256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:57.262417 (+ 161us) server_negotiation.cc:407] Connection header received
0812 20:58:57.262479 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:57.262480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:57.262497 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:57.262566 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:57.262951 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.263608 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.264393 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.264594 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.264655 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:57.267642 (+ 2987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:44071: BlockingRecv error: recv got EOF from 127.10.30.67:44071 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 20:58:57 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:57 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:57.953642 26075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:57.947775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:38047)
0812 20:58:57.947954 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:57.947974 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:57.948064 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:57.948288 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:57.948289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:57.948524 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:57.948592 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:57.948594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.949365 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.949366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:57.949972 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:57.949974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.950582 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.950583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:57.950640 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:57.951491 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:57.951532 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:57.953563 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
W20260812 20:58:57.953791 26076 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:57.947885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:38047 (local address 127.10.30.126:43005)
0812 20:58:57.948139 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:57.948141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:57.948150 (+ 9us) server_negotiation.cc:407] Connection header received
0812 20:58:57.948177 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:57.948177 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:57.948191 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:57.948265 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:57.948683 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.949264 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.950249 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:57.950474 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:57.950552 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:57.953687 (+ 3135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:38047: BlockingRecv error: recv got EOF from 127.10.30.65:38047 (error 108)
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":157,"threads_started":1}
Aug 12 20:58:58 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:58 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 20:58:58.127249 26076 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:58.121142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:39025 (local address 127.10.30.126:43005)
0812 20:58:58.121225 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:58.121227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:58.121352 (+ 125us) server_negotiation.cc:407] Connection header received
0812 20:58:58.121438 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:58.121439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:58.121456 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:58.121507 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:58.121985 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.122562 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.123421 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.123650 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.123711 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:58.127184 (+ 3473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:39025: BlockingRecv error: recv got EOF from 127.10.30.66:39025 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 20:58:58.127250 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:58.120909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:39025)
0812 20:58:58.121220 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:58.121242 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:58.121358 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:58.121566 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:58.121567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:58.121809 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:58.121877 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:58.121880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.122660 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.122661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:58.123318 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:58.123321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.123729 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.123730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:58.123788 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:58.124400 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:58.124405 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:58.127152 (+ 2747us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":145,"threads_started":1}
Aug 12 20:58:58 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:58 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:58.273747 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:58.268245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:50821)
0812 20:58:58.268430 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:58.268444 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:58.268528 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:58.268689 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:58.268690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:58.268944 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:58.269016 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:58.269019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.269737 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.269738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:58.270365 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:58.270367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.270705 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.270706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:58.270750 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:58.271439 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:58.271444 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:58.273667 (+ 2223us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":85,"threads_started":1}
W20260812 20:58:58.274004 26076 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:58.268355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:50821 (local address 127.10.30.126:43005)
0812 20:58:58.268448 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:58.268450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:58.268521 (+ 71us) server_negotiation.cc:407] Connection header received
0812 20:58:58.268595 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:58.268596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:58.268614 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:58.268670 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:58.269107 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.269659 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.270449 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.270638 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.270690 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:58.273804 (+ 3114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:50821: BlockingRecv error: recv got EOF from 127.10.30.67:50821 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 20:58:58 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:58 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:58.960197 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:58.954372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:59093)
0812 20:58:58.954579 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:58.954603 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:58.954690 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:58.954859 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:58.954860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:58.955174 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:58.955243 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:58.955246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.956074 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.956075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:58.956721 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:58.956723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.957142 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.957143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:58.957202 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:58.957823 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:58.957829 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:58.960101 (+ 2272us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":101,"threads_started":1}
W20260812 20:58:58.960320 26083 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:58.954475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:59093 (local address 127.10.30.126:43005)
0812 20:58:58.954700 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:58.954702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:58.954712 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:58:58.954741 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:58.954741 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:58.954755 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:58.954828 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:58.955328 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.955964 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.956816 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:58.957046 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:58.957110 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:58.960227 (+ 3117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:59093: BlockingRecv error: recv got EOF from 127.10.30.65:59093 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":82,"threads_started":1}
Aug 12 20:58:59 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:59 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:59.134172 26084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:59.128123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:59693)
0812 20:58:59.128374 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:59.128391 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:59.128505 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:59.128712 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:59.128713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:59.129010 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:59.129077 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:59.129080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.129855 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.129856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:59.130448 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:59.130450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.130862 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.130863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:59.130930 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:59.131686 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:59.131692 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:59.134093 (+ 2401us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":108,"threads_started":1}
W20260812 20:58:59.134441 26083 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:59.128205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:59693 (local address 127.10.30.126:43005)
0812 20:58:59.128380 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:59.128383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:59.128481 (+ 98us) server_negotiation.cc:407] Connection header received
0812 20:58:59.128605 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:59.128606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:59.128622 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:59.128703 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:59.129179 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.129754 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.130542 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.130768 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.130857 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:59.134381 (+ 3524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:59693: BlockingRecv error: recv got EOF from 127.10.30.66:59693 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 12 20:58:59 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:59 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.67@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:59.281265 26087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:59.274491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.67:42251)
0812 20:58:59.274642 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:59.274674 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:59.274756 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:59.274964 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:59.274966 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:59.275283 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:59.275363 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:59.275366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.276529 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.276531 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:59.277551 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:59.277555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.278122 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.278124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:59.278184 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:59.278854 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:59.278861 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:59.281154 (+ 2293us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
W20260812 20:58:59.281440 26083 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:59.274529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:42251 (local address 127.10.30.126:43005)
0812 20:58:59.274594 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:59.274598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:59.274732 (+ 134us) server_negotiation.cc:407] Connection header received
0812 20:58:59.274819 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:59.274820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:59.274842 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:59.274915 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:59.275473 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.276410 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.277667 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.278027 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.278109 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:59.281322 (+ 3213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.67:42251: BlockingRecv error: recv got EOF from 127.10.30.67:42251 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 12 20:58:59 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:58:59 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.65@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:58:59.966361 26088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:58:59.960892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.65:43233)
0812 20:58:59.961092 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 20:58:59.961105 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:58:59.961170 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:58:59.961334 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:58:59.961335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:58:59.961564 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:58:59.961633 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:59.961635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.962457 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.962458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:59.963093 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:58:59.963096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.963494 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.963495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:58:59.963540 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:59.964149 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:58:59.964155 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:58:59.966280 (+ 2125us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":110,"threads_started":1}
W20260812 20:58:59.966562 26090 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:58:59.961008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:43233 (local address 127.10.30.126:43005)
0812 20:58:59.961142 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 20:58:59.961144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:58:59.961167 (+ 23us) server_negotiation.cc:407] Connection header received
0812 20:58:59.961236 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:58:59.961237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:58:59.961251 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:58:59.961309 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:58:59.961747 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.962372 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.963189 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:58:59.963416 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:58:59.963485 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:58:59.966466 (+ 2981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.65:43233: BlockingRecv error: recv got EOF from 127.10.30.65:43233 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":68,"threads_started":1}
Aug 12 20:59:00 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 20:59:00 dist-test-slave-h3ft krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.30.66@KRBTEST.COM for oryx/127.10.30.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 20:59:00.141225 26094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:00.134938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43005 (local address 127.10.30.66:57293)
0812 20:59:00.135293 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:00.135308 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:00.135393 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:00.135601 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:00.135602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:00.135814 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:00.135896 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:00.135898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.136757 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.136758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:00.137410 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:00.137412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.137902 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.137903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:00.137954 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.138674 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:59:00.138679 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:00.141146 (+ 2467us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.30.126:43005: Server oryx/127.10.30.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":236,"threads_started":1}
W20260812 20:59:00.141429 26090 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:59:00.135068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:57293 (local address 127.10.30.126:43005)
0812 20:59:00.135165 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:00.135168 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:00.135421 (+ 253us) server_negotiation.cc:407] Connection header received
0812 20:59:00.135479 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:00.135480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:00.135498 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:00.135578 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:00.136060 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.136636 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.137577 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.137805 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.137878 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.141314 (+ 3436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.30.66:57293: BlockingRecv error: recv got EOF from 127.10.30.66:57293 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 20:59:00.178541 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 25224
I20260812 20:59:00.208794 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 25518
I20260812 20:59:00.222612 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 25766
I20260812 20:59:00.242278 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 25087
2026-08-12T20:59:00Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18264 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T20:59:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:59:00Z Disabled control of system clock
I20260812 20:59:00.305028 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:39207
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:37995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:39207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 20:59:00.406165 26100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:00.406445 26100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:00.406466 26100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:00.407966 26100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:59:00.408021 26100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:00.408034 26100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:00.408048 26100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:59:00.408061 26100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:59:00.409592 26100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:39207
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:39207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:00.409905 26100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:00.410324 26100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:00.416720 26110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:00.416749 26122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:00.416788 26100 server_base.cc:1034] running on GCE node
W20260812 20:59:00.416796 26120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:00.417371 26100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:00.417728 26100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:00.418891 26100 hybrid_clock.cc:648] HybridClock initialized: now 1786568340418859 us; error 55 us; skew 500 ppm
I20260812 20:59:00.420549 26100 webserver.cc:460] Webserver started at http://127.10.30.126:36323/ using document root <none> and password file <none>
I20260812 20:59:00.420858 26100 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:00.420914 26100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:00.421093 26100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:00.422374 26100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "be4b0b1f643744cb956069ce64db785d"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "bc3c194b9db1a18ef8033d46a583d29d"
server_key_iv: "942a397f0b04ee654d4c4108ba3fb231"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.422811 26100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "be4b0b1f643744cb956069ce64db785d"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "bc3c194b9db1a18ef8033d46a583d29d"
server_key_iv: "942a397f0b04ee654d4c4108ba3fb231"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.424558 26100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 20:59:00.425598 26131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.425904 26100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:00.426082 26100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "be4b0b1f643744cb956069ce64db785d"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "bc3c194b9db1a18ef8033d46a583d29d"
server_key_iv: "942a397f0b04ee654d4c4108ba3fb231"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.426177 26100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:00.433403 26100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:00.433810 26100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:00.433993 26100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:00.439782 26100 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:39207
I20260812 20:59:00.439823 26232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:39207 every 8 connection(s)
I20260812 20:59:00.440266 26100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:59:00.441184 26233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:59:00.442257 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 26100
I20260812 20:59:00.442361 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:59:00.442652 10361 external_mini_cluster.cc:1428] Setting key 96163361b79b8ba4d229176c8fa9f8b7
I20260812 20:59:00.445992 26233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d: Bootstrap starting.
I20260812 20:59:00.446923 26233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d: Neither blocks nor log segments found. Creating new log.
I20260812 20:59:00.447322 26233 log.cc:824] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d: Log is configured to *not* fsync() on all Append() calls
I20260812 20:59:00.448189 26233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d: No bootstrap required, opened a new log
I20260812 20:59:00.450663 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:00.443444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39004 (local address 127.10.30.126:39207)
0812 20:59:00.443768 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:00.443780 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:00.443833 (+ 53us) server_negotiation.cc:407] Connection header received
0812 20:59:00.444492 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:00.444502 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:00.444605 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:00.444807 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:00.445146 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.446695 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.447823 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.448402 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.448564 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.449630 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:00.449635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:00.449636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:59:00.449853 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:00.449908 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:59:00.449928 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:00.450037 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:00.450289 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 20:59:00.450422 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":127,"threads_started":1}
I20260812 20:59:00.450711 26233 raft_consensus.cc:348] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4b0b1f643744cb956069ce64db785d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39207 } }
I20260812 20:59:00.450970 26233 raft_consensus.cc:374] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:59:00.451040 26233 raft_consensus.cc:729] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be4b0b1f643744cb956069ce64db785d, State: Initialized, Role: FOLLOWER
I20260812 20:59:00.451216 26233 consensus_queue.cc:260] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4b0b1f643744cb956069ce64db785d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39207 } }
I20260812 20:59:00.451333 26233 raft_consensus.cc:388] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:59:00.451380 26233 raft_consensus.cc:482] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:59:00.451438 26233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:59:00.452201 26233 raft_consensus.cc:504] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4b0b1f643744cb956069ce64db785d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39207 } }
I20260812 20:59:00.452348 26233 leader_election.cc:302] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be4b0b1f643744cb956069ce64db785d; no voters:
I20260812 20:59:00.452589 26233 leader_election.cc:288] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:59:00.452809 26245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:59:00.452942 26233 sys_catalog.cc:564] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:59:00.453174 26245 raft_consensus.cc:686] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [term 1 LEADER]: Becoming Leader. State: Replica: be4b0b1f643744cb956069ce64db785d, State: Running, Role: LEADER
I20260812 20:59:00.453394 26245 consensus_queue.cc:237] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4b0b1f643744cb956069ce64db785d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39207 } }
I20260812 20:59:00.453977 26247 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4b0b1f643744cb956069ce64db785d. Latest consensus state: current_term: 1 leader_uuid: "be4b0b1f643744cb956069ce64db785d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4b0b1f643744cb956069ce64db785d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39207 } } }
I20260812 20:59:00.454183 26247 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [sys.catalog]: This master's current role is: LEADER
I20260812 20:59:00.454223 26246 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be4b0b1f643744cb956069ce64db785d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4b0b1f643744cb956069ce64db785d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 39207 } } }
I20260812 20:59:00.454356 26246 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d [sys.catalog]: This master's current role is: LEADER
I20260812 20:59:00.454841 26272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:59:00.455585 26272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:59:00.457865 26272 catalog_manager.cc:1347] Generated new cluster ID: fc4954a24e9f406a888d1eee7d1ef75d
I20260812 20:59:00.457962 26272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:59:00.466580 26272 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:59:00.467496 26272 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:59:00.470050 26272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be4b0b1f643744cb956069ce64db785d: Generated new TSK 0
I20260812 20:59:00.470311 26272 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 20:59:00.474390 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39207
--builtin_ntp_servers=127.10.30.84:37995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 20:59:00.596726 26288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:00.596977 26288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:00.597003 26288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:00.598345 26288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:00.598398 26288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:00.598428 26288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:59:00.600075 26288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:00.600378 26288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:00.600788 26288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:00.607103 26295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:00.607215 26297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:00.607156 26299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:00.607719 26288 server_base.cc:1034] running on GCE node
I20260812 20:59:00.608047 26288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:00.608345 26288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:00.609522 26288 hybrid_clock.cc:648] HybridClock initialized: now 1786568340609492 us; error 59 us; skew 500 ppm
I20260812 20:59:00.611379 26288 webserver.cc:460] Webserver started at http://127.10.30.65:43003/ using document root <none> and password file <none>
I20260812 20:59:00.611708 26288 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:00.611804 26288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:00.611991 26288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:00.613443 26288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "d5194ef868d4427f9c7e8b5c99cd878b"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "b08066e31277ff65cf540a5dcaf38994"
server_key_iv: "5861ba3b6eec7fdf32de6c7d2c2e7b01"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.613894 26288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "d5194ef868d4427f9c7e8b5c99cd878b"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "b08066e31277ff65cf540a5dcaf38994"
server_key_iv: "5861ba3b6eec7fdf32de6c7d2c2e7b01"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.615716 26288 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 20:59:00.616771 26312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.617089 26288 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:00.617264 26288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "d5194ef868d4427f9c7e8b5c99cd878b"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "b08066e31277ff65cf540a5dcaf38994"
server_key_iv: "5861ba3b6eec7fdf32de6c7d2c2e7b01"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.617390 26288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:00.641450 26288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:00.641968 26288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:00.642180 26288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:00.642577 26288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:00.643081 26288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:00.643196 26288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.643254 26288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:00.643272 26288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.653921 26288 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:46355
I20260812 20:59:00.654033 26517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:46355 every 8 connection(s)
I20260812 20:59:00.654561 26288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:59:00.662024 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:00.655717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:58205 (local address 127.10.30.126:39207)
0812 20:59:00.655788 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:00.655791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:00.656099 (+ 308us) server_negotiation.cc:407] Connection header received
0812 20:59:00.656659 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:00.656661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:00.656677 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:00.656796 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:00.657614 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.658197 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.660189 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.660438 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.660528 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.661636 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:00.661637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:00.661638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:59:00.661644 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:00.661662 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:59:00.661667 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:00.661745 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:00.661848 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 20:59:00.661894 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 20:59:00.662158 26522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:00.655694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39207 (local address 127.10.30.65:58205)
0812 20:59:00.655929 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:00.655975 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:00.656532 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:00.656877 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:00.656882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:00.656891 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:00.657473 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:00.657478 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.658354 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.658355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:00.660022 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:00.660026 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.660547 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.660548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:00.660749 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.661465 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:59:00.661466 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:00.661499 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:59:00.661525 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:00.661761 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:00.661767 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:00.661770 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 20:59:00.661832 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 20:59:00.661927 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":119,"threads_started":1}
I20260812 20:59:00.663362 26519 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39207
I20260812 20:59:00.663527 26519 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:00.663609 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 26288
I20260812 20:59:00.663734 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:59:00.663878 26519 heartbeater.cc:511] Master 127.10.30.126:39207 requested a full tablet report, sending...
I20260812 20:59:00.663996 10361 external_mini_cluster.cc:1428] Setting key 9aaa4cc9385dd54fe57e2077e0d9a3be
I20260812 20:59:00.664707 26170 ts_manager.cc:194] Registered new tserver with Master: d5194ef868d4427f9c7e8b5c99cd878b (127.10.30.65:46355)
I20260812 20:59:00.665494 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39207
--builtin_ntp_servers=127.10.30.84:37995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 20:59:00.665609 26170 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.65:58205
W20260812 20:59:00.760449 26526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:00.760743 26526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:00.760779 26526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:00.762264 26526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:00.762327 26526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:00.762360 26526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:59:00.763924 26526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:00.764178 26526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:00.764511 26526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:00.771368 26534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:00.771411 26526 server_base.cc:1034] running on GCE node
W20260812 20:59:00.771420 26535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:00.771384 26537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:00.772008 26526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:00.772279 26526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:00.773496 26526 hybrid_clock.cc:648] HybridClock initialized: now 1786568340773460 us; error 57 us; skew 500 ppm
I20260812 20:59:00.775444 26526 webserver.cc:460] Webserver started at http://127.10.30.66:39581/ using document root <none> and password file <none>
I20260812 20:59:00.775761 26526 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:00.775849 26526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:00.776041 26526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:00.777339 26526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "09c08f19fab34247883478f3240947f7"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "21dbce2aac3381e608e50305aca8c0b7"
server_key_iv: "e60fccfa712eae0e81da9f84fdd4fff2"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.777776 26526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "09c08f19fab34247883478f3240947f7"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "21dbce2aac3381e608e50305aca8c0b7"
server_key_iv: "e60fccfa712eae0e81da9f84fdd4fff2"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.779560 26526 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 20:59:00.780691 26556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.781010 26526 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:00.781172 26526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "09c08f19fab34247883478f3240947f7"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "21dbce2aac3381e608e50305aca8c0b7"
server_key_iv: "e60fccfa712eae0e81da9f84fdd4fff2"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.781268 26526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:00.797816 26526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:00.798249 26526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:00.798440 26526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:00.798767 26526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:00.799337 26526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:00.799412 26526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.799459 26526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:00.799511 26526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.807888 26526 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:40623
I20260812 20:59:00.807951 26782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:40623 every 8 connection(s)
I20260812 20:59:00.808360 26526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:59:00.813402 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 26526
I20260812 20:59:00.813517 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:59:00.813758 10361 external_mini_cluster.cc:1428] Setting key 0bf1e4008619abcc22cf292f8682ea9d
I20260812 20:59:00.815343 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39207
--builtin_ntp_servers=127.10.30.84:37995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 20:59:00.816195 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:00.809498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:59541 (local address 127.10.30.126:39207)
0812 20:59:00.809606 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:00.809609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:00.809907 (+ 298us) server_negotiation.cc:407] Connection header received
0812 20:59:00.810557 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:00.810559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:00.810641 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:00.810738 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:00.811908 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.812542 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.813900 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.814194 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.814281 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.815732 (+ 1451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:00.815734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:00.815735 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:59:00.815743 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:00.815772 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:59:00.815779 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:00.815850 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:00.815967 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 20:59:00.816056 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 20:59:00.816318 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:00.809432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39207 (local address 127.10.30.66:59541)
0812 20:59:00.809715 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:00.809769 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:00.810412 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:00.810924 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:00.810938 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:00.810950 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:00.811774 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:00.811782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.812671 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.812673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:00.813769 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:00.813773 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.814353 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.814356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:00.814545 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.815447 (+ 902us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:59:00.815448 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:00.815487 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:59:00.815554 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:00.815863 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:00.815869 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:00.815872 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 20:59:00.815943 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 20:59:00.816088 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":133,"threads_started":1}
I20260812 20:59:00.818202 26783 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39207
I20260812 20:59:00.818372 26783 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:00.818646 26783 heartbeater.cc:511] Master 127.10.30.126:39207 requested a full tablet report, sending...
I20260812 20:59:00.819270 26170 ts_manager.cc:194] Registered new tserver with Master: 09c08f19fab34247883478f3240947f7 (127.10.30.66:40623)
I20260812 20:59:00.819743 26170 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.66:59541
W20260812 20:59:00.917197 26786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:00.917430 26786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:00.917454 26786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:00.918668 26786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:00.918727 26786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:00.918754 26786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:59:00.920238 26786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:39207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:00.920516 26786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:00.920845 26786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:00.926950 26802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:00.926929 26796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:00.926923 26786 server_base.cc:1034] running on GCE node
W20260812 20:59:00.926923 26799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:00.927614 26786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:00.927953 26786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:00.929141 26786 hybrid_clock.cc:648] HybridClock initialized: now 1786568340929124 us; error 31 us; skew 500 ppm
I20260812 20:59:00.931123 26786 webserver.cc:460] Webserver started at http://127.10.30.67:42959/ using document root <none> and password file <none>
I20260812 20:59:00.931496 26786 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:00.931588 26786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:00.931782 26786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:00.933274 26786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "a2b248f25cf848dfbecbcb746baba370"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "33d93aa4f206a194b3898864e7af8822"
server_key_iv: "8c5baf72fc64df472b29deb6ae4ab32c"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.933768 26786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "a2b248f25cf848dfbecbcb746baba370"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "33d93aa4f206a194b3898864e7af8822"
server_key_iv: "8c5baf72fc64df472b29deb6ae4ab32c"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.935698 26786 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260812 20:59:00.936820 26809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.937191 26786 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:00.937327 26786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "a2b248f25cf848dfbecbcb746baba370"
format_stamp: "Formatted at 2026-08-12 20:59:00 on dist-test-slave-h3ft"
server_key: "33d93aa4f206a194b3898864e7af8822"
server_key_iv: "8c5baf72fc64df472b29deb6ae4ab32c"
server_key_version: "encryptionkey@0"
I20260812 20:59:00.937426 26786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:00.956875 26786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:00.957412 26786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:00.957625 26786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:00.957993 26786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:00.958475 26786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:00.958521 26786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.958551 26786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:00.958618 26786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:00.967954 26786 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:35975
I20260812 20:59:00.968025 27010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:35975 every 8 connection(s)
I20260812 20:59:00.968539 26786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:59:00.974282 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 26786
I20260812 20:59:00.974416 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:59:00.974646 10361 external_mini_cluster.cc:1428] Setting key 19f3108ed82c8bbe99a3a24ecd85a208
I20260812 20:59:00.975804 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:00.969674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:33677 (local address 127.10.30.126:39207)
0812 20:59:00.969747 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:00.969749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:00.970181 (+ 432us) server_negotiation.cc:407] Connection header received
0812 20:59:00.970871 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:00.970873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:00.970888 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:00.970967 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:00.971875 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.972434 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.973646 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.973914 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.974025 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.975406 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:00.975407 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:00.975408 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:59:00.975416 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:00.975440 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:59:00.975446 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:00.975522 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:00.975663 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 20:59:00.975702 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 20:59:00.976037 27014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:00.969627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:39207 (local address 127.10.30.67:33677)
0812 20:59:00.969968 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:00.970023 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:00.970722 (+ 699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:00.971130 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:00.971134 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:00.971160 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:00.971733 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:00.971738 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.972587 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.972588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:00.973506 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:00.973509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:00.974086 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:00.974087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:00.974292 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:00.975150 (+ 858us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:59:00.975151 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:00.975199 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:59:00.975264 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:00.975546 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:00.975552 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:00.975556 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 20:59:00.975661 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 20:59:00.975795 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":114,"threads_started":1}
I20260812 20:59:00.976722 27011 heartbeater.cc:347] Connected to a master server at 127.10.30.126:39207
I20260812 20:59:00.976837 27011 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:00.977053 27011 heartbeater.cc:511] Master 127.10.30.126:39207 requested a full tablet report, sending...
I20260812 20:59:00.977577 26170 ts_manager.cc:194] Registered new tserver with Master: a2b248f25cf848dfbecbcb746baba370 (127.10.30.67:35975)
I20260812 20:59:00.978025 26170 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.67:33677
I20260812 20:59:00.987627 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 20:59:00.989931 26241 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:59:00.989343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39014 (local address 127.10.30.126:39207)
0812 20:59:00.989431 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:00.989434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:00.989551 (+ 117us) server_negotiation.cc:407] Connection header received
0812 20:59:00.989626 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:00.989627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:00.989640 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:00.989693 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:00.989857 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39014: BlockingRecv error: recv got EOF from 127.0.0.1:39014 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 20:59:00.990267 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 26288
I20260812 20:59:01.025177 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 26526
I20260812 20:59:01.043634 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 26786
I20260812 20:59:01.062240 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 26100
2026-08-12T20:59:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (807 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T20:59:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:59:01Z Disabled control of system clock
I20260812 20:59:01.113819 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41983
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:33573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:41983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 20:59:01.210769 27028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:01.211077 27028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:01.211104 27028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:01.212373 27028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:59:01.212415 27028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:01.212428 27028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:01.212440 27028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:59:01.212456 27028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:59:01.213894 27028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:33573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:41983
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:01.214160 27028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:01.214480 27028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:01.220984 27034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:01.220963 27028 server_base.cc:1034] running on GCE node
W20260812 20:59:01.221252 27035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:01.220966 27039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:01.221711 27028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:01.222110 27028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:01.223290 27028 hybrid_clock.cc:648] HybridClock initialized: now 1786568341223249 us; error 58 us; skew 500 ppm
I20260812 20:59:01.225006 27028 webserver.cc:460] Webserver started at http://127.10.30.126:33159/ using document root <none> and password file <none>
I20260812 20:59:01.225356 27028 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:01.225415 27028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:01.225615 27028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:01.226965 27028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "409ff376f5964ecfb0ea695cc6537c96"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "b915c84fcac8743766cd5b76c220e253"
server_key_iv: "055d8128049a136f89a27d74a442539f"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.227458 27028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "409ff376f5964ecfb0ea695cc6537c96"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "b915c84fcac8743766cd5b76c220e253"
server_key_iv: "055d8128049a136f89a27d74a442539f"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.229023 27028 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 20:59:01.229979 27049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.230289 27028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:59:01.230461 27028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "409ff376f5964ecfb0ea695cc6537c96"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "b915c84fcac8743766cd5b76c220e253"
server_key_iv: "055d8128049a136f89a27d74a442539f"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.230541 27028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:01.234521 27028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:01.234877 27028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:01.235059 27028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:01.241289 27028 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:41983
I20260812 20:59:01.241377 27140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:41983 every 8 connection(s)
I20260812 20:59:01.241880 27028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:59:01.242837 27143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:59:01.246352 27143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96: Bootstrap starting.
I20260812 20:59:01.247253 27143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96: Neither blocks nor log segments found. Creating new log.
I20260812 20:59:01.247668 27143 log.cc:824] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96: Log is configured to *not* fsync() on all Append() calls
I20260812 20:59:01.248689 27143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96: No bootstrap required, opened a new log
I20260812 20:59:01.250752 27143 raft_consensus.cc:348] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409ff376f5964ecfb0ea695cc6537c96" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41983 } }
I20260812 20:59:01.250945 27143 raft_consensus.cc:374] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:59:01.250972 27143 raft_consensus.cc:729] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 409ff376f5964ecfb0ea695cc6537c96, State: Initialized, Role: FOLLOWER
I20260812 20:59:01.251257 27143 consensus_queue.cc:260] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409ff376f5964ecfb0ea695cc6537c96" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41983 } }
I20260812 20:59:01.251369 27143 raft_consensus.cc:388] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:59:01.251413 27143 raft_consensus.cc:482] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:59:01.251478 27143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:59:01.251538 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 27028
I20260812 20:59:01.251693 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:59:01.252005 10361 external_mini_cluster.cc:1428] Setting key 933fe265e0e25e1d4ce7715ce80ac879
I20260812 20:59:01.252424 27143 raft_consensus.cc:504] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409ff376f5964ecfb0ea695cc6537c96" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41983 } }
I20260812 20:59:01.252591 27143 leader_election.cc:302] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 409ff376f5964ecfb0ea695cc6537c96; no voters:
I20260812 20:59:01.252825 27143 leader_election.cc:288] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:59:01.252972 27148 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:59:01.253206 27148 raft_consensus.cc:686] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [term 1 LEADER]: Becoming Leader. State: Replica: 409ff376f5964ecfb0ea695cc6537c96, State: Running, Role: LEADER
I20260812 20:59:01.253226 27143 sys_catalog.cc:564] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:59:01.253463 27148 consensus_queue.cc:237] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409ff376f5964ecfb0ea695cc6537c96" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41983 } }
I20260812 20:59:01.254483 27153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 409ff376f5964ecfb0ea695cc6537c96. Latest consensus state: current_term: 1 leader_uuid: "409ff376f5964ecfb0ea695cc6537c96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409ff376f5964ecfb0ea695cc6537c96" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41983 } } }
I20260812 20:59:01.254609 27153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [sys.catalog]: This master's current role is: LEADER
I20260812 20:59:01.254824 27151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "409ff376f5964ecfb0ea695cc6537c96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409ff376f5964ecfb0ea695cc6537c96" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41983 } } }
I20260812 20:59:01.254944 27151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96 [sys.catalog]: This master's current role is: LEADER
I20260812 20:59:01.255265 27164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:59:01.255348 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:01.252732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59198 (local address 127.10.30.126:41983)
0812 20:59:01.253098 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:01.253110 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:01.253159 (+ 49us) server_negotiation.cc:407] Connection header received
0812 20:59:01.253316 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:01.253325 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:01.253389 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:01.253588 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:01.254483 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:01.254487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:01.254488 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:59:01.254494 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:01.254554 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:59:01.254571 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:01.254983 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:01.255048 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 20:59:01.255122 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":187,"threads_started":1}
I20260812 20:59:01.256242 27164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:59:01.258399 27164 catalog_manager.cc:1347] Generated new cluster ID: 273dbc9e2f7c4a36b1307b3a9150bd7f
I20260812 20:59:01.258489 27164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:59:01.267853 27164 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:59:01.268126 27164 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:59:01.292418 27164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 409ff376f5964ecfb0ea695cc6537c96: Generated new TSK 0
I20260812 20:59:01.292745 27164 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 20:59:01.302780 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41983
--builtin_ntp_servers=127.10.30.84:33573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 20:59:01.404985 27179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:01.405289 27179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:01.405320 27179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:01.406783 27179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:01.406845 27179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:01.406877 27179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:59:01.408582 27179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:33573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:01.408962 27179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:01.409384 27179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:01.415436 27191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:01.415567 27188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:01.415573 27193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:01.416112 27179 server_base.cc:1034] running on GCE node
I20260812 20:59:01.416415 27179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:01.416661 27179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:01.417834 27179 hybrid_clock.cc:648] HybridClock initialized: now 1786568341417812 us; error 35 us; skew 500 ppm
I20260812 20:59:01.419685 27179 webserver.cc:460] Webserver started at http://127.10.30.65:42277/ using document root <none> and password file <none>
I20260812 20:59:01.419994 27179 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:01.420046 27179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:01.420219 27179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:01.421576 27179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "81c3a461a7604c15933376998887e3ab"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "6965483e9bf28552a372106b62ed1f5a"
server_key_iv: "f9238106ea6dba5f992bb12e9f44a6da"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.422011 27179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "81c3a461a7604c15933376998887e3ab"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "6965483e9bf28552a372106b62ed1f5a"
server_key_iv: "f9238106ea6dba5f992bb12e9f44a6da"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.423696 27179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260812 20:59:01.424655 27208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.424903 27179 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:59:01.425076 27179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "81c3a461a7604c15933376998887e3ab"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "6965483e9bf28552a372106b62ed1f5a"
server_key_iv: "f9238106ea6dba5f992bb12e9f44a6da"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.425168 27179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:01.429143 27179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:01.429508 27179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:01.429664 27179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:01.429906 27179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:01.430305 27179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:01.430366 27179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.430413 27179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:01.430445 27179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.438488 27179 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:45065
I20260812 20:59:01.438583 27407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:45065 every 8 connection(s)
I20260812 20:59:01.439074 27179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:59:01.440711 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 27179
I20260812 20:59:01.440834 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:59:01.441082 10361 external_mini_cluster.cc:1428] Setting key 434f6214b1d8af7889583a4148c73570
I20260812 20:59:01.442413 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41983
--builtin_ntp_servers=127.10.30.84:33573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 20:59:01.443701 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:01.440242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:56965 (local address 127.10.30.126:41983)
0812 20:59:01.440352 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:01.440382 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:01.440772 (+ 390us) server_negotiation.cc:407] Connection header received
0812 20:59:01.441576 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:01.441578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:01.441586 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:01.441632 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:01.443396 (+ 1764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:01.443398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:01.443398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:59:01.443403 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:01.443426 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:59:01.443431 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:01.443490 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:01.443611 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 20:59:01.443630 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 20:59:01.443994 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:01.440222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41983 (local address 127.10.30.65:56965)
0812 20:59:01.440561 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:01.440622 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:01.441432 (+ 810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:01.441720 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:01.441725 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:01.441737 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:01.443171 (+ 1434us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:59:01.443172 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:01.443224 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:59:01.443273 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:01.443512 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:01.443520 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:01.443523 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 20:59:01.443617 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 20:59:01.443700 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":110,"threads_started":1}
I20260812 20:59:01.444820 27409 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41983
I20260812 20:59:01.444952 27409 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:01.445143 27409 heartbeater.cc:511] Master 127.10.30.126:41983 requested a full tablet report, sending...
I20260812 20:59:01.445804 27078 ts_manager.cc:194] Registered new tserver with Master: 81c3a461a7604c15933376998887e3ab (127.10.30.65:45065)
W20260812 20:59:01.540391 27416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:01.540647 27416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:01.540674 27416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:01.542023 27416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:01.542066 27416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:01.542096 27416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:59:01.543567 27416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:33573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:01.543880 27416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:01.544263 27416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:01.550457 27426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:01.550449 27432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:01.550678 27416 server_base.cc:1034] running on GCE node
W20260812 20:59:01.550504 27428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:01.551127 27416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:01.551455 27416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:01.552640 27416 hybrid_clock.cc:648] HybridClock initialized: now 1786568341552631 us; error 35 us; skew 500 ppm
I20260812 20:59:01.554565 27416 webserver.cc:460] Webserver started at http://127.10.30.66:42315/ using document root <none> and password file <none>
I20260812 20:59:01.554811 27416 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:01.554858 27416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:01.554978 27416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:01.556366 27416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "1483aef04925474f8b693f8e239c3be3"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "35b0195f751f347489b358a88dec9888"
server_key_iv: "78819f00ee2251136c05c814fdcc5e02"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.556770 27416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "1483aef04925474f8b693f8e239c3be3"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "35b0195f751f347489b358a88dec9888"
server_key_iv: "78819f00ee2251136c05c814fdcc5e02"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.558271 27416 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 20:59:01.559320 27442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.559654 27416 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:01.559759 27416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "1483aef04925474f8b693f8e239c3be3"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "35b0195f751f347489b358a88dec9888"
server_key_iv: "78819f00ee2251136c05c814fdcc5e02"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.559827 27416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:01.563822 27416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:01.564121 27416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:01.564235 27416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:01.564450 27416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:01.564759 27416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:01.564790 27416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.564811 27416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:01.564831 27416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.572167 27416 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:40973
I20260812 20:59:01.572253 27645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:40973 every 8 connection(s)
I20260812 20:59:01.572688 27416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:59:01.576664 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:01.573664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:34725 (local address 127.10.30.126:41983)
0812 20:59:01.573792 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:01.573795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:01.574038 (+ 243us) server_negotiation.cc:407] Connection header received
0812 20:59:01.574758 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:01.574760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:01.574769 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:01.574835 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:01.576333 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:01.576335 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:01.576335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:59:01.576341 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:01.576372 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:59:01.576378 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:01.576461 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:01.576551 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 20:59:01.576572 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 20:59:01.576932 27650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:01.573557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41983 (local address 127.10.30.66:34725)
0812 20:59:01.573855 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:01.573896 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:01.574608 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:01.574919 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:01.574923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:01.574932 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:01.576142 (+ 1210us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:59:01.576143 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:01.576191 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:59:01.576226 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:01.576449 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:01.576457 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:01.576460 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 20:59:01.576563 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 20:59:01.576639 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":123,"threads_started":1}
I20260812 20:59:01.577757 27646 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41983
I20260812 20:59:01.577884 27646 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:01.578078 27646 heartbeater.cc:511] Master 127.10.30.126:41983 requested a full tablet report, sending...
I20260812 20:59:01.578552 27078 ts_manager.cc:194] Registered new tserver with Master: 1483aef04925474f8b693f8e239c3be3 (127.10.30.66:40973)
I20260812 20:59:01.580561 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 27416
I20260812 20:59:01.580677 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:59:01.580869 10361 external_mini_cluster.cc:1428] Setting key 1f9a33755f351e5ea3997282a7c6b2a2
I20260812 20:59:01.582140 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41983
--builtin_ntp_servers=127.10.30.84:33573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 20:59:01.687176 27651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:01.687484 27651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:01.687515 27651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:01.688951 27651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:01.688995 27651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:01.689025 27651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:59:01.690646 27651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:33573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:01.690912 27651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:01.691342 27651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:01.697849 27664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:01.697849 27667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:01.697965 27663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:01.698283 27651 server_base.cc:1034] running on GCE node
I20260812 20:59:01.698617 27651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:01.698971 27651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:01.700248 27651 hybrid_clock.cc:648] HybridClock initialized: now 1786568341700215 us; error 42 us; skew 500 ppm
I20260812 20:59:01.702106 27651 webserver.cc:460] Webserver started at http://127.10.30.67:39667/ using document root <none> and password file <none>
I20260812 20:59:01.702411 27651 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:01.702466 27651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:01.702618 27651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:01.704046 27651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "bfb6ced481a14bdf98b68a4c2413d8e4"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "fa11efb10611367be41f4ab3683f2d81"
server_key_iv: "c75d7bf4a079ac3f9b9a92e109e904c7"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.704524 27651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "bfb6ced481a14bdf98b68a4c2413d8e4"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "fa11efb10611367be41f4ab3683f2d81"
server_key_iv: "c75d7bf4a079ac3f9b9a92e109e904c7"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.706292 27651 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260812 20:59:01.707454 27677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.707675 27651 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:01.707804 27651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "bfb6ced481a14bdf98b68a4c2413d8e4"
format_stamp: "Formatted at 2026-08-12 20:59:01 on dist-test-slave-h3ft"
server_key: "fa11efb10611367be41f4ab3683f2d81"
server_key_iv: "c75d7bf4a079ac3f9b9a92e109e904c7"
server_key_version: "encryptionkey@0"
I20260812 20:59:01.707901 27651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:01.712226 27651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:01.712608 27651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:01.712775 27651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:01.713057 27651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:01.713462 27651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:01.713528 27651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.713577 27651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:01.713608 27651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:01.721992 27651 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:38465
I20260812 20:59:01.722069 27884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:38465 every 8 connection(s)
I20260812 20:59:01.722576 27651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 20:59:01.726881 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:01.723713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:59941 (local address 127.10.30.126:41983)
0812 20:59:01.723817 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:01.723820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:01.724080 (+ 260us) server_negotiation.cc:407] Connection header received
0812 20:59:01.724726 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:01.724728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:01.724736 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:01.724813 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:01.726546 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:01.726549 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:01.726549 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 20:59:01.726556 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:01.726578 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 20:59:01.726584 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:01.726654 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:01.726763 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 20:59:01.726781 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 20:59:01.727245 27889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:01.723653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41983 (local address 127.10.30.67:59941)
0812 20:59:01.723893 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:01.723945 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:01.724588 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:01.725019 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:01.725024 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:01.725035 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:01.726278 (+ 1243us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 20:59:01.726278 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:01.726330 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 20:59:01.726373 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:01.726663 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:01.726669 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:01.726672 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 20:59:01.726751 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 20:59:01.726829 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":115,"threads_started":1}
I20260812 20:59:01.728153 27885 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41983
I20260812 20:59:01.728330 27885 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:01.728551 27885 heartbeater.cc:511] Master 127.10.30.126:41983 requested a full tablet report, sending...
I20260812 20:59:01.729120 27078 ts_manager.cc:194] Registered new tserver with Master: bfb6ced481a14bdf98b68a4c2413d8e4 (127.10.30.67:38465)
I20260812 20:59:01.730419 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 27651
I20260812 20:59:01.730574 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:59:01.730823 10361 external_mini_cluster.cc:1428] Setting key d03bc59b2c3b1c51ce356099421507ab
I20260812 20:59:01.732429 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 20:59:01.735379 27149 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 20:59:01.734378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59214 (local address 127.10.30.126:41983)
0812 20:59:01.734441 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:01.734444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:01.734645 (+ 201us) server_negotiation.cc:407] Connection header received
0812 20:59:01.734702 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:01.734703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:01.734711 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:01.734775 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:01.735004 (+ 229us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59214: BlockingRecv error: recv got EOF from 127.0.0.1:59214 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 20:59:01.735517 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 27179
I20260812 20:59:01.759389 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 27416
I20260812 20:59:01.796357 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 27651
I20260812 20:59:01.811815 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 27028
2026-08-12T20:59:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (754 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:59:01 dist-test-slave-h3ft krb5kdc[27911](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:59:01 dist-test-slave-h3ft krb5kdc[27911](info): set up 2 sockets
Aug 12 20:59:01 dist-test-slave-h3ft krb5kdc[27911](info): commencing operation
krb5kdc: starting...
W20260812 20:59:03.173171 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.319s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:59:03 dist-test-slave-h3ft krb5kdc[27911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:59:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:59:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:59:03.323674 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:34099
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:34099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:59:03.422600 27931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:03.422960 27931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:03.423008 27931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:03.424521 27931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:59:03.424628 27931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:03.424651 27931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:03.424676 27931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:59:03.424706 27931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:59:03.426663 27931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:34099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:34099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:03.427076 27931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:03.427383 27931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:03.433575 27942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:03.433575 27940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:03.433596 27939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:03.433774 27931 server_base.cc:1034] running on GCE node
I20260812 20:59:03.434356 27931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:03.434798 27931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:03.436067 27931 hybrid_clock.cc:648] HybridClock initialized: now 1786568343436016 us; error 70 us; skew 500 ppm
Aug 12 20:59:03 dist-test-slave-h3ft krb5kdc[27911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:59:03.444031 27931 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:59:03.444693 27931 webserver.cc:460] Webserver started at http://127.10.30.126:33973/ using document root <none> and password file <none>
I20260812 20:59:03.444975 27931 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:03.445052 27931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:03.445226 27931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:03.446537 27931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "7656549b8b8a4786b9ae7af27bacd8b8"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "327443ba322b4fb27f41838d0476419e"
server_key_iv: "8bb8817f66d896321060c2850324ee29"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.446986 27931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "7656549b8b8a4786b9ae7af27bacd8b8"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "327443ba322b4fb27f41838d0476419e"
server_key_iv: "8bb8817f66d896321060c2850324ee29"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.448734 27931 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:59:03.449806 27957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:03.450099 27931 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:59:03.450244 27931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "7656549b8b8a4786b9ae7af27bacd8b8"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "327443ba322b4fb27f41838d0476419e"
server_key_iv: "8bb8817f66d896321060c2850324ee29"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.450348 27931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:03.460620 27931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:03.463585 27931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:03.463798 27931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:03.469316 27931 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:34099
I20260812 20:59:03.469494 28046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:34099 every 8 connection(s)
I20260812 20:59:03.469902 27931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:59:03.471437 28048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:59:03.471465 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 27931
I20260812 20:59:03.471575 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:59:03.471864 10361 external_mini_cluster.cc:1428] Setting key 185e699018016598556ba9a72e5c6bb4
I20260812 20:59:03.475970 28048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8: Bootstrap starting.
I20260812 20:59:03.476981 28048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8: Neither blocks nor log segments found. Creating new log.
I20260812 20:59:03.477424 28048 log.cc:824] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8: Log is configured to *not* fsync() on all Append() calls
I20260812 20:59:03.478358 28048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8: No bootstrap required, opened a new log
Aug 12 20:59:03 dist-test-slave-h3ft krb5kdc[27911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:59:03.481601 28048 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7656549b8b8a4786b9ae7af27bacd8b8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34099 } }
I20260812 20:59:03.481849 28048 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:59:03.481953 28048 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7656549b8b8a4786b9ae7af27bacd8b8, State: Initialized, Role: FOLLOWER
I20260812 20:59:03.482192 28048 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7656549b8b8a4786b9ae7af27bacd8b8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34099 } }
I20260812 20:59:03.482314 28048 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:59:03.482357 28048 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:59:03.482414 28048 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:59:03.483496 28048 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7656549b8b8a4786b9ae7af27bacd8b8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34099 } }
I20260812 20:59:03.483639 28048 leader_election.cc:302] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7656549b8b8a4786b9ae7af27bacd8b8; no voters:
I20260812 20:59:03.483871 28048 leader_election.cc:288] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:59:03.484009 28060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:59:03.484239 28048 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:59:03.484282 28060 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [term 1 LEADER]: Becoming Leader. State: Replica: 7656549b8b8a4786b9ae7af27bacd8b8, State: Running, Role: LEADER
I20260812 20:59:03.484490 28060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7656549b8b8a4786b9ae7af27bacd8b8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34099 } }
I20260812 20:59:03.485646 28061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7656549b8b8a4786b9ae7af27bacd8b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7656549b8b8a4786b9ae7af27bacd8b8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34099 } } }
I20260812 20:59:03.485687 28062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7656549b8b8a4786b9ae7af27bacd8b8. Latest consensus state: current_term: 1 leader_uuid: "7656549b8b8a4786b9ae7af27bacd8b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7656549b8b8a4786b9ae7af27bacd8b8" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34099 } } }
I20260812 20:59:03.485865 28062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [sys.catalog]: This master's current role is: LEADER
I20260812 20:59:03.485854 28061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8 [sys.catalog]: This master's current role is: LEADER
I20260812 20:59:03.486205 28077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:59:03.486325 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:03.472644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39246 (local address 127.10.30.126:34099)
0812 20:59:03.472845 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:03.472854 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:03.472889 (+ 35us) server_negotiation.cc:407] Connection header received
0812 20:59:03.473494 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:03.473502 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:03.473561 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:03.473698 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:03.474695 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.475818 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.477104 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.477665 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.477818 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:03.481268 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:03.481275 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:03.481275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:59:03.481294 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:03.483964 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:03.484529 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:03.484533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:03.484533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:03.484646 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:03.484883 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:03.484884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:03.484884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:03.485380 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:03.485754 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:03.485839 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 20:59:03.486038 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260812 20:59:03.486873 28077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:59:03.488842 28077 catalog_manager.cc:1347] Generated new cluster ID: ca790c27c18249a2aa54ff43c0fc5ede
I20260812 20:59:03.488893 28077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:59:03.507995 28077 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:59:03.508661 28077 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:59:03.519903 28077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8: Generated new TSK 0
I20260812 20:59:03.520243 28077 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 20:59:03.560796 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34099
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:59:03.698673 28099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:03.698983 28099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:03.699045 28099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:03.700354 28099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:03.700398 28099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:03.700428 28099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 20:59:03.702039 28099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:03.702288 28099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:03.702543 28099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:03.708822 28106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:03.708838 28107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:03.708860 28111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:03.709151 28099 server_base.cc:1034] running on GCE node
I20260812 20:59:03.709398 28099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:03.709693 28099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:03.710901 28099 hybrid_clock.cc:648] HybridClock initialized: now 1786568343710868 us; error 58 us; skew 500 ppm
Aug 12 20:59:03 dist-test-slave-h3ft krb5kdc[27911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:59:03.714455 28099 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 20:59:03.715205 28099 webserver.cc:460] Webserver started at http://127.10.30.65:35165/ using document root <none> and password file <none>
I20260812 20:59:03.715493 28099 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:03.715570 28099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:03.715754 28099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:03.717144 28099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "c03c5407160346e29040723dc33c64fa"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "ae2dd63941576933d302594a80eb8236"
server_key_iv: "6e91f2a5b1417603b5850143cf6d774e"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.717614 28099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "c03c5407160346e29040723dc33c64fa"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "ae2dd63941576933d302594a80eb8236"
server_key_iv: "6e91f2a5b1417603b5850143cf6d774e"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.719460 28099 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 20:59:03.720538 28121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:03.720757 28099 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:03.720884 28099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "c03c5407160346e29040723dc33c64fa"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "ae2dd63941576933d302594a80eb8236"
server_key_iv: "6e91f2a5b1417603b5850143cf6d774e"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.721015 28099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:03.730934 28099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:03.734193 28099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:03.734449 28099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:03.735230 28099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:03.736081 28099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:03.736140 28099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:03.736217 28099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:03.736239 28099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:03.744864 28099 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:43549
I20260812 20:59:03.744925 28321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:43549 every 8 connection(s)
I20260812 20:59:03.745396 28099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 20:59:03.750941 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 28099
I20260812 20:59:03.751214 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 20:59:03.751495 10361 external_mini_cluster.cc:1428] Setting key 8407fc136b7d4319f9287360aac1a81c
Aug 12 20:59:03 dist-test-slave-h3ft krb5kdc[27911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:59:03.758340 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:03.746458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:39747 (local address 127.10.30.126:34099)
0812 20:59:03.746594 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:03.746597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:03.746811 (+ 214us) server_negotiation.cc:407] Connection header received
0812 20:59:03.747662 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:03.747664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:03.747680 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:03.747742 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:03.748997 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.749589 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.750766 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.751103 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.751186 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:03.754815 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:03.754817 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:03.754818 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:59:03.754827 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:03.756507 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:03.756991 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:03.756993 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:03.756993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:03.757075 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:03.757429 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:03.757430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:03.757431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:03.757621 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:03.757702 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:03.758041 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 20:59:03.758176 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 20:59:03.758400 28324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:03.746357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:34099 (local address 127.10.30.65:39747)
0812 20:59:03.746642 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:03.746706 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:03.747517 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:03.747827 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:03.747832 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:03.748583 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:03.748845 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:03.748851 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.749710 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.749711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:03.750645 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:03.750647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.751246 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.751247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:03.751443 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:03.752271 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:59:03.752282 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:03.754700 (+ 2418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:03.756593 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:59:03.756601 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:59:03.756604 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:59:03.756884 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:59:03.757182 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:59:03.757183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:59:03.757183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:59:03.757341 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:59:03.757697 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:03.757704 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:03.757883 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 20:59:03.757997 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 20:59:03.758173 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":121,"threads_started":1}
I20260812 20:59:03.759379 28322 heartbeater.cc:347] Connected to a master server at 127.10.30.126:34099
I20260812 20:59:03.759536 28322 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:03.759781 28322 heartbeater.cc:511] Master 127.10.30.126:34099 requested a full tablet report, sending...
I20260812 20:59:03.760565 27987 ts_manager.cc:194] Registered new tserver with Master: c03c5407160346e29040723dc33c64fa (127.10.30.65:43549)
I20260812 20:59:03.761287 27987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:39747
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 20:59:03.787129 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34099
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:59:03.886968 28327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:03.887276 28327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:03.887307 28327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:03.888682 28327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:03.888739 28327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:03.888772 28327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 20:59:03.890492 28327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:03.890816 28327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:03.891187 28327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:03.897111 28336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:03.897172 28337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:03.897219 28345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:03.897478 28327 server_base.cc:1034] running on GCE node
I20260812 20:59:03.897708 28327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:03.898016 28327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:03.899202 28327 hybrid_clock.cc:648] HybridClock initialized: now 1786568343899197 us; error 41 us; skew 500 ppm
Aug 12 20:59:03 dist-test-slave-h3ft krb5kdc[27911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:59:03.902272 28327 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 20:59:03.902881 28327 webserver.cc:460] Webserver started at http://127.10.30.66:37843/ using document root <none> and password file <none>
I20260812 20:59:03.903270 28327 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:03.903354 28327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:03.903543 28327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:03.904968 28327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "8f3b54fda38c4390bacd6d64b24d9b26"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "8d155a1eeacb349ab90f3af89fcc789a"
server_key_iv: "8842d91013d69c2f814d3901b4d06748"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.905438 28327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "8f3b54fda38c4390bacd6d64b24d9b26"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "8d155a1eeacb349ab90f3af89fcc789a"
server_key_iv: "8842d91013d69c2f814d3901b4d06748"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.907171 28327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 20:59:03.908143 28359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:03.908392 28327 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:03.908535 28327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "8f3b54fda38c4390bacd6d64b24d9b26"
format_stamp: "Formatted at 2026-08-12 20:59:03 on dist-test-slave-h3ft"
server_key: "8d155a1eeacb349ab90f3af89fcc789a"
server_key_iv: "8842d91013d69c2f814d3901b4d06748"
server_key_version: "encryptionkey@0"
I20260812 20:59:03.908630 28327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:03.939365 28327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:03.942616 28327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:03.942859 28327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:03.943238 28327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:03.943682 28327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:03.943748 28327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:03.943796 28327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:03.943843 28327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:03.951462 28327 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:40663
I20260812 20:59:03.951500 28575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:40663 every 8 connection(s)
I20260812 20:59:03.951941 28327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 20:59:03.955482 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 28327
I20260812 20:59:03.955644 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 20:59:03.955885 10361 external_mini_cluster.cc:1428] Setting key a73f7034c0e11eb0932510d2b5e652b0
Aug 12 20:59:03 dist-test-slave-h3ft krb5kdc[27911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:59:03.965226 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:03.952868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:39281 (local address 127.10.30.126:34099)
0812 20:59:03.952974 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:03.952977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:03.953235 (+ 258us) server_negotiation.cc:407] Connection header received
0812 20:59:03.953899 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:03.953901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:03.953915 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:03.953981 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:03.955391 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.956289 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.957785 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.958126 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.958213 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:03.961436 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:03.961439 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:03.961439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:59:03.961450 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:03.963453 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:03.964016 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:03.964018 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:03.964018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:03.964098 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:03.964408 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:03.964409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:03.964409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:03.964564 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:03.964642 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:03.965007 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 20:59:03.965111 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 20:59:03.965492 28579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:03.952818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:34099 (local address 127.10.30.66:39281)
0812 20:59:03.953042 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:03.953087 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:03.953759 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:03.954150 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:03.954155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:03.954929 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:03.955258 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:03.955263 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.956538 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.956540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:03.957662 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:03.957665 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:03.958234 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:03.958235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:03.958380 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:03.959171 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:59:03.959182 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:03.961290 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:03.963586 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:59:03.963600 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:59:03.963604 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:59:03.963913 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:59:03.964181 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:59:03.964183 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:59:03.964183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:59:03.964326 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:59:03.964641 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:03.964652 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:03.964838 (+ 186us) client_negotiation.cc:769] Sending connection context
0812 20:59:03.964962 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 20:59:03.965184 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":121,"threads_started":1}
I20260812 20:59:03.966253 28577 heartbeater.cc:347] Connected to a master server at 127.10.30.126:34099
I20260812 20:59:03.966405 28577 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:03.966691 28577 heartbeater.cc:511] Master 127.10.30.126:34099 requested a full tablet report, sending...
I20260812 20:59:03.967311 27987 ts_manager.cc:194] Registered new tserver with Master: 8f3b54fda38c4390bacd6d64b24d9b26 (127.10.30.66:40663)
I20260812 20:59:03.967813 27987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:39281
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 20:59:03.991401 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34099
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:59:04.092669 28583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:04.093026 28583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:04.093081 28583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:04.094611 28583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:04.094712 28583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:04.094770 28583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 20:59:04.096771 28583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:04.097153 28583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:04.097492 28583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:04.104539 28593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:04.104491 28589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:04.104492 28588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:04.104790 28583 server_base.cc:1034] running on GCE node
I20260812 20:59:04.105252 28583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:04.105646 28583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:04.106875 28583 hybrid_clock.cc:648] HybridClock initialized: now 1786568344106840 us; error 59 us; skew 500 ppm
Aug 12 20:59:04 dist-test-slave-h3ft krb5kdc[27911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:59:04.110769 28583 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 20:59:04.111567 28583 webserver.cc:460] Webserver started at http://127.10.30.67:38819/ using document root <none> and password file <none>
I20260812 20:59:04.111886 28583 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:04.111970 28583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:04.112223 28583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:59:04.113863 28583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "6eb4688fb1e1486a83dfd9c79be3bc79"
format_stamp: "Formatted at 2026-08-12 20:59:04 on dist-test-slave-h3ft"
server_key: "a9502993163b7b503307bca0f4e29c50"
server_key_iv: "00974930df31d6ee527b4d95c3353fbd"
server_key_version: "encryptionkey@0"
I20260812 20:59:04.114533 28583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "6eb4688fb1e1486a83dfd9c79be3bc79"
format_stamp: "Formatted at 2026-08-12 20:59:04 on dist-test-slave-h3ft"
server_key: "a9502993163b7b503307bca0f4e29c50"
server_key_iv: "00974930df31d6ee527b4d95c3353fbd"
server_key_version: "encryptionkey@0"
I20260812 20:59:04.116587 28583 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 20:59:04.117897 28608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:04.118239 28583 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:04.118391 28583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "6eb4688fb1e1486a83dfd9c79be3bc79"
format_stamp: "Formatted at 2026-08-12 20:59:04 on dist-test-slave-h3ft"
server_key: "a9502993163b7b503307bca0f4e29c50"
server_key_iv: "00974930df31d6ee527b4d95c3353fbd"
server_key_version: "encryptionkey@0"
I20260812 20:59:04.118502 28583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:04.147943 28583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:04.150928 28583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:04.151111 28583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:04.151371 28583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:59:04.151780 28583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:59:04.151819 28583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:04.151846 28583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:59:04.151859 28583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:04.160056 28583 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:44525
I20260812 20:59:04.160148 28810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:44525 every 8 connection(s)
I20260812 20:59:04.160593 28583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
Aug 12 20:59:04 dist-test-slave-h3ft krb5kdc[27911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:59:04.169783 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 28583
I20260812 20:59:04.169942 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 20:59:04.170375 10361 external_mini_cluster.cc:1428] Setting key 837a03b93c11517a192d968adec8b67a
I20260812 20:59:04.173018 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.161672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:52685 (local address 127.10.30.126:34099)
0812 20:59:04.161792 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:04.161795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:04.162070 (+ 275us) server_negotiation.cc:407] Connection header received
0812 20:59:04.162794 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:04.162795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:04.162813 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:04.162873 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:04.164156 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.164742 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.165863 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.166094 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.166187 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.169124 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:04.169126 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:04.169126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:59:04.169143 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:04.171373 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:04.171860 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:04.171862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:04.171863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:04.171941 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:04.172221 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:04.172222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:04.172222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:04.172370 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:04.172460 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:04.172810 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 20:59:04.172911 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 20:59:04.173283 28817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.161611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:34099 (local address 127.10.30.67:52685)
0812 20:59:04.161905 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:04.161951 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:04.162649 (+ 698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:04.162970 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:04.162974 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:04.163764 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0812 20:59:04.164036 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.164042 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.164874 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.164875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.165757 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.165759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.166205 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.166206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.166361 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.167159 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 20:59:04.167171 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 20:59:04.168980 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 20:59:04.171458 (+ 2478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:59:04.171472 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:59:04.171475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:59:04.171760 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:59:04.172016 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 20:59:04.172017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 20:59:04.172017 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 20:59:04.172149 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 20:59:04.172442 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 20:59:04.172450 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 20:59:04.172650 (+ 200us) client_negotiation.cc:769] Sending connection context
0812 20:59:04.172773 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 20:59:04.172991 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":110,"threads_started":1}
I20260812 20:59:04.173830 28815 heartbeater.cc:347] Connected to a master server at 127.10.30.126:34099
I20260812 20:59:04.173971 28815 heartbeater.cc:464] Registering TS with master...
I20260812 20:59:04.174239 28815 heartbeater.cc:511] Master 127.10.30.126:34099 requested a full tablet report, sending...
I20260812 20:59:04.174736 27987 ts_manager.cc:194] Registered new tserver with Master: 6eb4688fb1e1486a83dfd9c79be3bc79 (127.10.30.67:44525)
I20260812 20:59:04.175243 27987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:52685
I20260812 20:59:04.183091 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:59:04.192283 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.184967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39248 (local address 127.10.30.126:34099)
0812 20:59:04.185042 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:04.185045 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:04.185123 (+ 78us) server_negotiation.cc:407] Connection header received
0812 20:59:04.185290 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:04.185291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:04.185303 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:04.185364 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:04.186134 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.186799 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.187717 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.187964 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.188036 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.189578 (+ 1542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:04.189580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:04.189580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:59:04.189588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:04.190994 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:04.191424 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:04.191425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:04.191425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:04.191503 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:04.191697 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:04.191697 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:04.191698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:04.191893 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:04.192028 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:04.192118 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 20:59:04.192198 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 20:59:04.194247 27987 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:59:04.196470 27987 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:59:04.203992 28832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.199536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:44525 (local address 127.0.0.1:59172)
0812 20:59:04.199776 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:04.199832 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:04.199918 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:04.200344 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:04.200348 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:04.200350 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:59:04.200445 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.200448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.201524 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.201525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.202697 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.202700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.203633 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.203634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.203725 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.203741 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 20:59:04.203820 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 20:59:04.203883 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":77,"threads_started":1}
I20260812 20:59:04.204011 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.199753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59172 (local address 127.10.30.67:44525)
0812 20:59:04.200044 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:04.200051 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:04.200063 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:59:04.200115 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:04.200117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:04.200136 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:04.200223 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:59:04.200518 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.201401 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.202789 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.203543 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.203623 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.203690 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:04.203854 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 20:59:04.203909 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":124,"threads_started":1}
I20260812 20:59:04.204447 28835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.199820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:40663 (local address 127.0.0.1:44864)
0812 20:59:04.200189 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:04.200201 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:04.200261 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:04.200638 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:04.200639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:04.200642 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:59:04.200716 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.200719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.202142 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.202143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.203214 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.203216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.204211 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.204213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.204284 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.204289 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:59:04.204320 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 20:59:04.204365 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":26,"thread_start_us":106,"threads_started":1}
I20260812 20:59:04.204926 28836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.200131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44864 (local address 127.10.30.66:40663)
0812 20:59:04.200446 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:04.200449 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:04.200459 (+ 10us) server_negotiation.cc:407] Connection header received
0812 20:59:04.200503 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:04.200505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:04.200526 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:04.200805 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:59:04.200902 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.202014 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.203299 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.204097 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.204659 (+ 562us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.204738 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:04.204766 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 20:59:04.204818 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":134,"threads_started":1}
I20260812 20:59:04.205557 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.199574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:43549 (local address 127.0.0.1:46696)
0812 20:59:04.199995 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:04.200008 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:04.200079 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:04.200585 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:04.200585 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:04.200587 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:59:04.200626 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.200628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.202140 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.202141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.204142 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.204147 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.205276 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.205277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.205365 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.205370 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:59:04.205448 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 20:59:04.205492 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":74,"thread_start_us":129,"threads_started":1}
I20260812 20:59:04.205410 28695 tablet_service.cc:1467] Processing CreateTablet for tablet 87c5a24edb19440eaedc0132d8384d54 (DEFAULT_TABLE table=test-table [id=a0cbeeb25b4343038727e61cd56fdb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:59:04.205619 28834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.199779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46696 (local address 127.10.30.65:43549)
0812 20:59:04.200405 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:04.200410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:04.200422 (+ 12us) server_negotiation.cc:407] Connection header received
0812 20:59:04.200472 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:04.200474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:04.200492 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:04.200591 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:59:04.200737 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.202004 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.204237 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.205098 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.205178 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.205236 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:04.205468 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 20:59:04.205523 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":107,"threads_started":1}
I20260812 20:59:04.205739 28456 tablet_service.cc:1467] Processing CreateTablet for tablet 87c5a24edb19440eaedc0132d8384d54 (DEFAULT_TABLE table=test-table [id=a0cbeeb25b4343038727e61cd56fdb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:59:04.205911 28695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87c5a24edb19440eaedc0132d8384d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:59:04.206138 28456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87c5a24edb19440eaedc0132d8384d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:59:04.210248 28838 tablet_bootstrap.cc:492] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: Bootstrap starting.
I20260812 20:59:04.210704 28837 tablet_bootstrap.cc:492] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: Bootstrap starting.
I20260812 20:59:04.210884 28207 tablet_service.cc:1467] Processing CreateTablet for tablet 87c5a24edb19440eaedc0132d8384d54 (DEFAULT_TABLE table=test-table [id=a0cbeeb25b4343038727e61cd56fdb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 20:59:04.211387 28207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87c5a24edb19440eaedc0132d8384d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:59:04.211438 28838 tablet_bootstrap.cc:654] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: Neither blocks nor log segments found. Creating new log.
I20260812 20:59:04.211535 28837 tablet_bootstrap.cc:654] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: Neither blocks nor log segments found. Creating new log.
I20260812 20:59:04.212220 28837 log.cc:824] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: Log is configured to *not* fsync() on all Append() calls
I20260812 20:59:04.212248 28838 log.cc:824] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: Log is configured to *not* fsync() on all Append() calls
I20260812 20:59:04.213133 28838 tablet_bootstrap.cc:492] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: No bootstrap required, opened a new log
I20260812 20:59:04.213222 28837 tablet_bootstrap.cc:492] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: No bootstrap required, opened a new log
I20260812 20:59:04.213238 28838 ts_tablet_manager.cc:1397] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:59:04.213330 28837 ts_tablet_manager.cc:1397] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:59:04.214915 28838 raft_consensus.cc:348] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.215188 28838 raft_consensus.cc:374] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:59:04.215444 28838 raft_consensus.cc:729] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f3b54fda38c4390bacd6d64b24d9b26, State: Initialized, Role: FOLLOWER
I20260812 20:59:04.215615 28838 consensus_queue.cc:260] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.215811 28845 tablet_bootstrap.cc:492] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa: Bootstrap starting.
I20260812 20:59:04.216105 28577 heartbeater.cc:503] Master 127.10.30.126:34099 was elected leader, sending a full tablet report...
I20260812 20:59:04.216125 28838 ts_tablet_manager.cc:1428] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 20:59:04.216393 28837 raft_consensus.cc:348] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.216655 28837 raft_consensus.cc:374] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:59:04.216741 28837 raft_consensus.cc:729] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eb4688fb1e1486a83dfd9c79be3bc79, State: Initialized, Role: FOLLOWER
I20260812 20:59:04.216895 28837 consensus_queue.cc:260] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.217115 28845 tablet_bootstrap.cc:654] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa: Neither blocks nor log segments found. Creating new log.
I20260812 20:59:04.217290 28815 heartbeater.cc:503] Master 127.10.30.126:34099 was elected leader, sending a full tablet report...
I20260812 20:59:04.217284 28837 ts_tablet_manager.cc:1428] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 20:59:04.217849 28845 log.cc:824] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa: Log is configured to *not* fsync() on all Append() calls
I20260812 20:59:04.218724 28845 tablet_bootstrap.cc:492] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa: No bootstrap required, opened a new log
I20260812 20:59:04.218822 28845 ts_tablet_manager.cc:1397] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 20:59:04.220510 28845 raft_consensus.cc:348] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.220768 28845 raft_consensus.cc:374] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:59:04.220826 28845 raft_consensus.cc:729] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c03c5407160346e29040723dc33c64fa, State: Initialized, Role: FOLLOWER
I20260812 20:59:04.221060 28845 consensus_queue.cc:260] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.221401 28322 heartbeater.cc:503] Master 127.10.30.126:34099 was elected leader, sending a full tablet report...
I20260812 20:59:04.221423 28845 ts_tablet_manager.cc:1428] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 20:59:04.229038 28846 raft_consensus.cc:482] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:59:04.229275 28846 raft_consensus.cc:504] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.229816 28846 leader_election.cc:288] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6eb4688fb1e1486a83dfd9c79be3bc79 (127.10.30.67:44525), c03c5407160346e29040723dc33c64fa (127.10.30.65:43549)
I20260812 20:59:04.234745 28850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.230042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:44525 (local address 127.10.30.66:51879)
0812 20:59:04.230315 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:04.230323 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:04.230385 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:04.230567 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:04.230569 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:04.230572 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:59:04.230711 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.230712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.231838 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.231839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.233379 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.233383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.234304 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.234305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.234415 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.234444 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 20:59:04.234554 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 20:59:04.234617 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":182,"thread_start_us":159,"threads_started":1}
I20260812 20:59:04.234793 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.230231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:51879 (local address 127.10.30.67:44525)
0812 20:59:04.230289 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:04.230292 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:04.230387 (+ 95us) server_negotiation.cc:407] Connection header received
0812 20:59:04.230442 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:04.230443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:04.230455 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:04.230517 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:59:04.230899 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.231692 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.233531 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.234180 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.234250 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.234261 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:04.234584 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 20:59:04.234675 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 20:59:04.234938 28834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.230237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:39137 (local address 127.10.30.65:43549)
0812 20:59:04.230336 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:04.230337 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:04.230344 (+ 7us) server_negotiation.cc:407] Connection header received
0812 20:59:04.230393 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:04.230395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:04.230407 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:04.230477 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 20:59:04.230836 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.231705 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.233532 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.234152 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.234247 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.234261 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:04.234790 (+ 529us) server_negotiation.cc:299] Negotiation successful
0812 20:59:04.234857 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 20:59:04.234752 28579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.230041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:43549 (local address 127.10.30.66:39137)
0812 20:59:04.230107 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:04.230124 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 20:59:04.230191 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 20:59:04.230567 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 20:59:04.230569 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 20:59:04.230572 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 20:59:04.230703 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.230706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.231838 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.231839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.233378 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 20:59:04.233383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.234290 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.234291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 20:59:04.234506 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.234511 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 20:59:04.234582 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 20:59:04.234642 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":143}
I20260812 20:59:04.235661 28250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87c5a24edb19440eaedc0132d8384d54" candidate_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c03c5407160346e29040723dc33c64fa" is_pre_election: true
I20260812 20:59:04.235807 28725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87c5a24edb19440eaedc0132d8384d54" candidate_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" is_pre_election: true
I20260812 20:59:04.235980 28250 raft_consensus.cc:2454] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f3b54fda38c4390bacd6d64b24d9b26 in term 0.
I20260812 20:59:04.236030 28725 raft_consensus.cc:2454] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f3b54fda38c4390bacd6d64b24d9b26 in term 0.
I20260812 20:59:04.236312 28361 leader_election.cc:302] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6eb4688fb1e1486a83dfd9c79be3bc79, 8f3b54fda38c4390bacd6d64b24d9b26; no voters:
I20260812 20:59:04.236500 28846 raft_consensus.cc:2781] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:59:04.236583 28846 raft_consensus.cc:482] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:59:04.236603 28846 raft_consensus.cc:3037] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:59:04.237676 28846 raft_consensus.cc:504] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.237888 28846 leader_election.cc:288] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [CANDIDATE]: Term 1 election: Requested vote from peers 6eb4688fb1e1486a83dfd9c79be3bc79 (127.10.30.67:44525), c03c5407160346e29040723dc33c64fa (127.10.30.65:43549)
I20260812 20:59:04.238118 28250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87c5a24edb19440eaedc0132d8384d54" candidate_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c03c5407160346e29040723dc33c64fa"
I20260812 20:59:04.238133 28725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87c5a24edb19440eaedc0132d8384d54" candidate_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79"
I20260812 20:59:04.238230 28725 raft_consensus.cc:3037] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:59:04.238255 28250 raft_consensus.cc:3037] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:59:04.239300 28250 raft_consensus.cc:2454] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f3b54fda38c4390bacd6d64b24d9b26 in term 1.
I20260812 20:59:04.239327 28725 raft_consensus.cc:2454] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f3b54fda38c4390bacd6d64b24d9b26 in term 1.
I20260812 20:59:04.239521 28362 leader_election.cc:302] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f3b54fda38c4390bacd6d64b24d9b26, c03c5407160346e29040723dc33c64fa; no voters:
I20260812 20:59:04.239694 28846 raft_consensus.cc:2781] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:59:04.239951 28846 raft_consensus.cc:686] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 1 LEADER]: Becoming Leader. State: Replica: 8f3b54fda38c4390bacd6d64b24d9b26, State: Running, Role: LEADER
I20260812 20:59:04.240108 28846 consensus_queue.cc:237] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } }
I20260812 20:59:04.241324 27987 catalog_manager.cc:5495] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f3b54fda38c4390bacd6d64b24d9b26 (127.10.30.66). New cstate: current_term: 1 leader_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f3b54fda38c4390bacd6d64b24d9b26" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40663 } health_report { overall_health: HEALTHY } } }
W20260812 20:59:04.246387 28323 tablet.cc:2369] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:59:04.251464 28836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.248417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44868 (local address 127.10.30.66:40663)
0812 20:59:04.248487 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:04.248489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:04.248500 (+ 11us) server_negotiation.cc:407] Connection header received
0812 20:59:04.248584 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:04.248586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:04.248607 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:04.248695 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 20:59:04.248975 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.249530 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.250426 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:04.250643 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:04.250739 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:04.250947 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 20:59:04.251152 (+ 205us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 20:59:04.251255 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:04.251291 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 20:59:04.251319 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 20:59:04.254220 28250 raft_consensus.cc:1261] T 87c5a24edb19440eaedc0132d8384d54 P c03c5407160346e29040723dc33c64fa [term 1 FOLLOWER]: Refusing update from remote peer 8f3b54fda38c4390bacd6d64b24d9b26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:59:04.254223 28725 raft_consensus.cc:1261] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 1 FOLLOWER]: Refusing update from remote peer 8f3b54fda38c4390bacd6d64b24d9b26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:59:04.254714 28851 consensus_queue.cc:1035] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c03c5407160346e29040723dc33c64fa" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:59:04.254899 28846 consensus_queue.cc:1035] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6eb4688fb1e1486a83dfd9c79be3bc79" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 44525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:59:04.257932 28867 mvcc.cc:205] Tried to move back new op lower bound from 7317783938060849152 to 7317783938008489984. Current Snapshot: MvccSnapshot[applied={T|T < 7317783938060849152}]
I20260812 20:59:04.260893 28864 mvcc.cc:205] Tried to move back new op lower bound from 7317783938060849152 to 7317783938008489984. Current Snapshot: MvccSnapshot[applied={T|T < 7317783938060849152 or (T in {7317783938060849152})}]
I20260812 20:59:04.261199 27984 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:59:04.261343 27984 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 20:59:04.262385 27984 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7656549b8b8a4786b9ae7af27bacd8b8: Sending DeleteTablet for 3 replicas of tablet 87c5a24edb19440eaedc0132d8384d54
I20260812 20:59:04.262847 28695 tablet_service.cc:1514] Processing DeleteTablet for tablet 87c5a24edb19440eaedc0132d8384d54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:59:04 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:59172
I20260812 20:59:04.262969 28456 tablet_service.cc:1514] Processing DeleteTablet for tablet 87c5a24edb19440eaedc0132d8384d54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:59:04 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:44864
I20260812 20:59:04.263290 28878 tablet_replica.cc:330] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: stopping tablet replica
I20260812 20:59:04.263306 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 28099
I20260812 20:59:04.263403 28207 tablet_service.cc:1514] Processing DeleteTablet for tablet 87c5a24edb19440eaedc0132d8384d54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 20:59:04 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:46696
I20260812 20:59:04.263568 28878 raft_consensus.cc:2229] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 20:59:04.263734 28878 raft_consensus.cc:2258] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:59:04.267916 28878 ts_tablet_manager.cc:1905] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:59:04.270382 28878 ts_tablet_manager.cc:1918] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:59:04.270583 28878 log.cc:1196] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/87c5a24edb19440eaedc0132d8384d54
I20260812 20:59:04.271096 28878 ts_tablet_manager.cc:1939] T 87c5a24edb19440eaedc0132d8384d54 P 6eb4688fb1e1486a83dfd9c79be3bc79: Deleting consensus metadata
I20260812 20:59:04.271772 27960 catalog_manager.cc:4841] TS 6eb4688fb1e1486a83dfd9c79be3bc79 (127.10.30.67:44525): tablet 87c5a24edb19440eaedc0132d8384d54 (table test-table [id=a0cbeeb25b4343038727e61cd56fdb1c]) successfully deleted
I20260812 20:59:04.276417 28879 tablet_replica.cc:330] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: stopping tablet replica
I20260812 20:59:04.276618 28879 raft_consensus.cc:2229] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 1 LEADER]: Raft consensus shutting down.
I20260812 20:59:04.276774 28879 raft_consensus.cc:2258] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 20:59:04.277514 28879 ts_tablet_manager.cc:1905] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 20:59:04.279536 28879 ts_tablet_manager.cc:1918] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 20:59:04.279659 28879 log.cc:1196] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/87c5a24edb19440eaedc0132d8384d54
I20260812 20:59:04.279985 28879 ts_tablet_manager.cc:1939] T 87c5a24edb19440eaedc0132d8384d54 P 8f3b54fda38c4390bacd6d64b24d9b26: Deleting consensus metadata
I20260812 20:59:04.280568 27961 catalog_manager.cc:4841] TS 8f3b54fda38c4390bacd6d64b24d9b26 (127.10.30.66:40663): tablet 87c5a24edb19440eaedc0132d8384d54 (table test-table [id=a0cbeeb25b4343038727e61cd56fdb1c]) successfully deleted
W20260812 20:59:04.284530 27961 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:43549 (error 108)
I20260812 20:59:04.284850 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 28327
I20260812 20:59:04.293263 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:04.293040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:43549 (local address 127.0.0.1:46700)
0812 20:59:04.293124 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 20:59:04.293191 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:43549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 20:59:04.293459 27961 catalog_manager.cc:4584] TS c03c5407160346e29040723dc33c64fa (127.10.30.65:43549): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 87c5a24edb19440eaedc0132d8384d54: Network error: Client connection negotiation failed: client connection to 127.10.30.65:43549: connect: Connection refused (error 111)
I20260812 20:59:04.312505 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 28583
I20260812 20:59:04.325310 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 27931
2026-08-12T20:59:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2504 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 20:59:04 dist-test-slave-h3ft krb5kdc[28889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 20:59:04 dist-test-slave-h3ft krb5kdc[28889](info): set up 2 sockets
Aug 12 20:59:04 dist-test-slave-h3ft krb5kdc[28889](info): commencing operation
krb5kdc: starting...
W20260812 20:59:05.692153 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 20:59:05 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T20:59:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:59:05Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.30.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.30.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/rangeradmin_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/rangeradmin_127.10.30.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.30.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.30.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/rangerlookup_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/rangerlookup_127.10.30.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.30.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.30.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/HTTP_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/HTTP_127.10.30.84@KRBTEST.COM.keytab.
I20260812 20:59:05.923882 10361 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskDgHCG3/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/postgres -l logfile start
2026-08-12 20:59:09.178 UTC [28937] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 20:59:09.179 UTC [28937] LOG: listening on IPv4 address "127.10.30.84", port 38419
2026-08-12 20:59:09.184 UTC [28937] LOG: listening on Unix socket "/tmp/.s.PGSQL.38419"
2026-08-12 20:59:09.212 UTC [28943] LOG: database system was shut down at 2026-08-12 20:59:07 UTC
2026-08-12 20:59:09.217 UTC [28937] LOG: database system is ready to accept connections
I20260812 20:59:10.490276 10361 mini_postgres.cc:96] Postgres bound to 38419
2026-08-12 20:59:10.500 UTC [28960] FATAL: database "slave" does not exist
127.10.30.84:38419 - accepting connections
I20260812 20:59:10.501362 10361 mini_ranger.cc:161] Starting Ranger...
I20260812 20:59:10.522083 10361 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 20:59:11.162432 10361 mini_ranger.cc:87] Created ranger Postgres database
I20260812 20:59:11.162529 10361 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-admin
2026-08-12 20:59:11,624 [I] DB FLAVOR :POSTGRES
2026-08-12 20:59:11,625 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 20:59:11,625 [I] Checking connection..
2026-08-12 20:59:11,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 20:59:11,955 [I] Checking connection passed.
2026-08-12 20:59:11,956 [I] --------- Verifying version history table ---------
2026-08-12 20:59:11,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 20:59:12,277 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 20:59:12,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 20:59:12,574 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 20:59:12,574 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 20:59:12,574 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 20:59:12.863 UTC [29079] WARNING: there is no transaction in progress
2026-08-12 20:59:12,877 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 20:59:12,877 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 20:59:13,201 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 20:59:13,201 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 20:59:13,202 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 20:59:13,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 20:59:13,824 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-h3ft.c.gcp-upstream.internal','N') ;"
2026-08-12 20:59:14,129 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 20:59:14,437 [I] Table x_portal_user does not exist in database ranger
2026-08-12 20:59:14,437 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 20:59:14,756 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 20:59:14,757 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 20:59:15,063 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 20:59:15,354 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 20:59:15,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 20:59:16.603 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.625 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.646 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.668 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.691 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.718 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.790 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.799 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.819 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.832 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.847 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.864 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.877 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.885 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.895 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:16.904 UTC [29277] WARNING: there is no transaction in progress
2026-08-12 20:59:17,808 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 20:59:17,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 20:59:18,097 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 20:59:18,098 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 20:59:18,416 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 20:59:18,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 20:59:18,739 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 20:59:18,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 20:59:19,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 20:59:19,322 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-h3ft.c.gcp-upstream.internal';"
2026-08-12 20:59:19,636 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 20:59:19,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 20:59:19,946 [I] DB_PATCHES have already been applied
I20260812 20:59:19.955076 10361 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-admin:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskDgHCG3/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 20:59:19.955209 10361 mini_ranger.cc:193] Using host: 127.10.30.84
I20260812 20:59:19.960737 10361 mini_ranger.cc:227] Ranger admin URL: http://127.10.30.84:43577
Aug 12, 2026 8:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 8:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 8:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 8:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 8:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 8:59:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 8:59:21 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 20:59:21.466863 10361 mini_ranger.cc:160] Time spent starting Ranger: real 10.966s user 0.001s sys 0.014s
Aug 12, 2026 8:59:46 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 8:59:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 8:59:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 8:59:46 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 8:59:47 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 20:59:48.202068 10361 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.30.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.30.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/rangerkms_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/rangerkms_127.10.30.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.30.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.30.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.30.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/HTTP_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.30.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/HTTP_127.10.30.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 20:59:48 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568388, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 20:59:48.324249 10361 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 20:59:48.339550 10361 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 20:59:49.382543 10361 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 20:59:49.382668 10361 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms
I20260812 20:59:49.382688 10361 mini_ranger_kms.cc:227] Using postgres at 127.10.30.84:38419
2026-08-12 20:59:49,770 [I] DB FLAVOR :POSTGRES
2026-08-12 20:59:49,770 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 20:59:49,770 [I] Checking connection
2026-08-12 20:59:49,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 20:59:50,107 [I] connection success
2026-08-12 20:59:50,108 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 20:59:50,108 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 20:59:50,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 20:59:50,400 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 20:59:50,400 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 20:59:50,401 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 20:59:50,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:38419/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 20:59:50,714 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 20:59:51.344404 10361 mini_ranger_kms.cc:310] Created kms service
I20260812 20:59:51.596616 10361 mini_ranger_kms.cc:326] Created kudu user
I20260812 20:59:51.660332 10361 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 20:59:51 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568388, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 20:59:52.180153 10361 mini_ranger_kms.cc:384] Added ranger policy
I20260812 20:59:52.180316 10361 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms:/tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 20:59:52.180339 10361 mini_ranger_kms.cc:240] Using host: 127.10.30.84
I20260812 20:59:52.186826 10361 mini_ranger_kms.cc:276] Ranger KMS PID: 29607
I20260812 20:59:52.187067 10361 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.30.84:37333
Aug 12, 2026 8:59:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 8:59:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 8:59:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 8:59:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 8:59:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 8:59:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 20:59:54 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786568394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.30.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:59:55.212505 10361 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.888s user 0.002s sys 0.357s
I20260812 20:59:55.212666 10361 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 20:59:55.212771 10361 mini_ranger_kms.cc:401] 127.10.30.84:37333/kms/v1/keys
Aug 12 20:59:55 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.30.84@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
Aug 12 20:59:55 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.30.84@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
Aug 12 20:59:58 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 20:59:58.737416 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:45491
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:45491
--ranger_config_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:37333/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 20:59:58.861308 29705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:59:58.861672 29705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:59:58.861720 29705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:59:58.863348 29705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:59:58.863430 29705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 20:59:58.863454 29705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:59:58.863476 29705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:59:58.863523 29705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:59:58.865864 29705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.30.84:37333/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:45491
--ranger_config_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:45491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:59:58.866219 29705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:59:58.866509 29705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:59:58.874676 29712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:59:58.874855 29711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:58.874698 29705 server_base.cc:1034] running on GCE node
W20260812 20:59:58.874676 29714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:59:58.875515 29705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:59:58.875937 29705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:59:58.877146 29705 hybrid_clock.cc:648] HybridClock initialized: now 1786568398877115 us; error 47 us; skew 500 ppm
Aug 12 20:59:58 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568398, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 20:59:58.887365 29705 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 20:59:58.888147 29705 webserver.cc:460] Webserver started at http://127.10.30.126:34777/ using document root <none> and password file <none>
I20260812 20:59:58.888499 29705 fs_manager.cc:359] Metadata directory not provided
I20260812 20:59:58.888569 29705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:59:58.888769 29705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 20:59:58 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568398, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 20:59:58.957461 29705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "09c212f37ace44caa2a88b0573d31fb6"
format_stamp: "Formatted at 2026-08-12 20:59:58 on dist-test-slave-h3ft"
server_key: "6c467de44b24b96c126e28553a31c5a5"
server_key_iv: "d727098ac256c7d7e9c4eacfafbb047e"
server_key_version: "kuduclusterkey@0"
I20260812 20:59:58.958078 29705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "09c212f37ace44caa2a88b0573d31fb6"
format_stamp: "Formatted at 2026-08-12 20:59:58 on dist-test-slave-h3ft"
server_key: "6c467de44b24b96c126e28553a31c5a5"
server_key_iv: "d727098ac256c7d7e9c4eacfafbb047e"
server_key_version: "kuduclusterkey@0"
I20260812 20:59:58.960500 29705 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260812 20:59:58.979900 29728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:59:58.980262 29705 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:59:58.980422 29705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "09c212f37ace44caa2a88b0573d31fb6"
format_stamp: "Formatted at 2026-08-12 20:59:58 on dist-test-slave-h3ft"
server_key: "6c467de44b24b96c126e28553a31c5a5"
server_key_iv: "d727098ac256c7d7e9c4eacfafbb047e"
server_key_version: "kuduclusterkey@0"
I20260812 20:59:58.980564 29705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:59:59.007148 29705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:59:59.010493 29705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:59:59.010710 29705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:59:59.021456 29705 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:45491
I20260812 20:59:59.021540 29831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:45491 every 8 connection(s)
I20260812 20:59:59.022287 29705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 20:59:59.023515 29834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:59:59.027156 29834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6: Bootstrap starting.
I20260812 20:59:59.028059 29834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6: Neither blocks nor log segments found. Creating new log.
I20260812 20:59:59.028718 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 29705
I20260812 20:59:59.028721 29834 log.cc:824] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6: Log is configured to *not* fsync() on all Append() calls
I20260812 20:59:59.028852 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 20:59:59.029098 10361 external_mini_cluster.cc:1428] Setting key 466c57ce610e93463844027f101bef8f
I20260812 20:59:59.030056 29834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6: No bootstrap required, opened a new log
I20260812 20:59:59.035132 29834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c212f37ace44caa2a88b0573d31fb6" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45491 } }
I20260812 20:59:59.035496 29834 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:59:59.035580 29834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09c212f37ace44caa2a88b0573d31fb6, State: Initialized, Role: FOLLOWER
I20260812 20:59:59.035779 29834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c212f37ace44caa2a88b0573d31fb6" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45491 } }
I20260812 20:59:59.035885 29834 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:59:59.035924 29834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:59:59.036020 29834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:59:59.037142 29834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c212f37ace44caa2a88b0573d31fb6" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45491 } }
I20260812 20:59:59.037297 29834 leader_election.cc:302] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09c212f37ace44caa2a88b0573d31fb6; no voters:
Aug 12 20:59:59 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 20:59:59.037621 29834 leader_election.cc:288] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:59:59.037708 29843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:59:59.038019 29843 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [term 1 LEADER]: Becoming Leader. State: Replica: 09c212f37ace44caa2a88b0573d31fb6, State: Running, Role: LEADER
I20260812 20:59:59.038277 29834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:59:59.038234 29843 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c212f37ace44caa2a88b0573d31fb6" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45491 } }
I20260812 20:59:59.039839 29843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09c212f37ace44caa2a88b0573d31fb6. Latest consensus state: current_term: 1 leader_uuid: "09c212f37ace44caa2a88b0573d31fb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c212f37ace44caa2a88b0573d31fb6" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45491 } } }
I20260812 20:59:59.040028 29843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [sys.catalog]: This master's current role is: LEADER
I20260812 20:59:59.041644 29853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:59:59.042183 29834 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 20:59:59.042570 29853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:59:59.043409 29845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09c212f37ace44caa2a88b0573d31fb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c212f37ace44caa2a88b0573d31fb6" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45491 } } }
I20260812 20:59:59.043602 29845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6 [sys.catalog]: This master's current role is: LEADER
I20260812 20:59:59.044108 29840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 20:59:59.029836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55420 (local address 127.10.30.126:45491)
0812 20:59:59.030086 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 20:59:59.030101 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 20:59:59.030259 (+ 158us) server_negotiation.cc:407] Connection header received
0812 20:59:59.030928 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 20:59:59.030938 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 20:59:59.031068 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 20:59:59.031269 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0812 20:59:59.032051 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:59.033076 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:59.033924 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 20:59:59.034534 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 20:59:59.034707 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 20:59:59.038068 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 20:59:59.038074 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 20:59:59.038075 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 20:59:59.038094 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 20:59:59.040863 (+ 2769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:59.041479 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:59.041483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:59.041483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:59.041825 (+ 342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 20:59:59.042207 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 20:59:59.042208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 20:59:59.042208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 20:59:59.042654 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 20:59:59.042898 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 20:59:59.043655 (+ 757us) server_negotiation.cc:299] Negotiation successful
0812 20:59:59.043808 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":141,"threads_started":1}
I20260812 20:59:59.053138 29853 catalog_manager.cc:1347] Generated new cluster ID: 90a4b18c174146ab981c5c3f6f10daa6
I20260812 20:59:59.053521 29853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:59:59.060081 29853 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:59:59.061206 29853 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:59:59.075894 29853 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6: Generated new TSK 0
I20260812 20:59:59.076414 29853 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 21:00:00.087901 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:37333/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45491
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:00:00.241331 29916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:00:00.241669 29916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:00:00.241720 29916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:00:00.243494 29916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:00:00.243584 29916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:00:00.243638 29916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:00:00.246032 29916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.30.84:37333/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:00:00.246425 29916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:00:00.246788 29916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:00:00.255080 29924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:00:00.255280 29925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:00:00.255590 29928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:00:00.255913 29916 server_base.cc:1034] running on GCE node
I20260812 21:00:00.256176 29916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:00:00.256526 29916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:00:00.257761 29916 hybrid_clock.cc:648] HybridClock initialized: now 1786568400257722 us; error 56 us; skew 500 ppm
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:00:00.262089 29916 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:00:00.262871 29916 webserver.cc:460] Webserver started at http://127.10.30.65:40831/ using document root <none> and password file <none>
I20260812 21:00:00.263234 29916 fs_manager.cc:359] Metadata directory not provided
I20260812 21:00:00.263316 29916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:00:00.263494 29916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:00:00.282996 29916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "adbe24cbe13345a6b213abefaae71311"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "a1a1857a1fc39e06f850e77a5d955955"
server_key_iv: "cf2f076792eb06d03f3d16510902cbec"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.283753 29916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "adbe24cbe13345a6b213abefaae71311"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "a1a1857a1fc39e06f850e77a5d955955"
server_key_iv: "cf2f076792eb06d03f3d16510902cbec"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.286134 29916 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 21:00:00.310426 29944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:00.310818 29916 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.002s
I20260812 21:00:00.310952 29916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "adbe24cbe13345a6b213abefaae71311"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "a1a1857a1fc39e06f850e77a5d955955"
server_key_iv: "cf2f076792eb06d03f3d16510902cbec"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.311126 29916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:00:00.337275 29916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:00:00.341318 29916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:00:00.341675 29916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:00:00.342255 29916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:00:00.343056 29916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:00:00.343138 29916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:00.343182 29916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:00:00.343240 29916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:00.359159 29916 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:43297
I20260812 21:00:00.360028 29916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:00:00.361272 30151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:43297 every 8 connection(s)
I20260812 21:00:00.362740 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 29916
I20260812 21:00:00.362885 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:00:00.363282 10361 external_mini_cluster.cc:1428] Setting key 8b8baf5035e9b42cd27acd5077bf737f
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
I20260812 21:00:00.381356 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:00.363103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:54397 (local address 127.10.30.126:45491)
0812 21:00:00.367540 (+ 4437us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:00.367543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:00.367556 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:00:00.367592 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:00.367594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:00.367612 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:00.369043 (+ 1431us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:00:00.369117 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:00.370031 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:00.372037 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:00.372386 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:00.376393 (+ 4007us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:00.376490 (+ 97us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:00:00.376492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:00:00.376492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:00:00.376498 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:00:00.379071 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:00.379775 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:00.379777 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:00.379778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:00.379862 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:00.380274 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:00.380275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:00.380275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:00.380468 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:00:00.380564 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:00.381087 (+ 523us) server_negotiation.cc:299] Negotiation successful
0812 21:00:00.381215 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4391,"thread_start_us":78,"threads_started":1}
I20260812 21:00:00.381614 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:00.362269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45491 (local address 127.10.30.65:54397)
0812 21:00:00.363367 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:00.363437 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:00.364638 (+ 1201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:00.367878 (+ 3240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:00.367886 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:00.368431 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:00:00.368909 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:00.368919 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:00.370172 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:00.370173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:00.371900 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:00.371906 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:00.372500 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:00.372502 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:00.372785 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:00.373696 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:00:00.373710 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:00:00.376238 (+ 2528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:00:00.379185 (+ 2947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:00:00.379200 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:00:00.379204 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:00:00.379631 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:00:00.379970 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:00:00.379971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:00:00.379971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:00:00.380177 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:00:00.380573 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:00:00.380582 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:00:00.380823 (+ 241us) client_negotiation.cc:769] Sending connection context
0812 21:00:00.380975 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 21:00:00.381285 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1003,"thread_start_us":180,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
I20260812 21:00:00.382478 30153 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45491
I20260812 21:00:00.382643 30153 heartbeater.cc:464] Registering TS with master...
I20260812 21:00:00.382951 30153 heartbeater.cc:511] Master 127.10.30.126:45491 requested a full tablet report, sending...
I20260812 21:00:00.383915 29760 ts_manager.cc:194] Registered new tserver with Master: adbe24cbe13345a6b213abefaae71311 (127.10.30.65:43297)
I20260812 21:00:00.385033 29760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:54397
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 21:00:00.410828 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:37333/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45491
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 21:00:00.588260 30163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:00:00.588665 30163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:00:00.588711 30163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:00:00.591470 30163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:00:00.591688 30163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:00:00.591815 30163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:00:00.595188 30163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.30.84:37333/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:00:00.595871 30163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:00:00.596312 30163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:00:00.604816 30177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:00:00.605180 30163 server_base.cc:1034] running on GCE node
W20260812 21:00:00.604882 30186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:00:00.605322 30180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:00:00.605829 30163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:00:00.606204 30163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:00:00.607399 30163 hybrid_clock.cc:648] HybridClock initialized: now 1786568400607367 us; error 50 us; skew 500 ppm
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:00:00.611581 30163 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:00:00.612241 30163 webserver.cc:460] Webserver started at http://127.10.30.66:43931/ using document root <none> and password file <none>
I20260812 21:00:00.612663 30163 fs_manager.cc:359] Metadata directory not provided
I20260812 21:00:00.612733 30163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:00:00.612939 30163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:00:00.632272 30163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "58ad09d080c24fd4a7ee782fd0f00f21"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "780fec0601ec1aee3d087b366c896c62"
server_key_iv: "c6f09b745179081abdab5252d72b0790"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.633172 30163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "58ad09d080c24fd4a7ee782fd0f00f21"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "780fec0601ec1aee3d087b366c896c62"
server_key_iv: "c6f09b745179081abdab5252d72b0790"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.637288 30163 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 21:00:00.654677 30197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:00.654987 30163 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260812 21:00:00.655174 30163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "58ad09d080c24fd4a7ee782fd0f00f21"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "780fec0601ec1aee3d087b366c896c62"
server_key_iv: "c6f09b745179081abdab5252d72b0790"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.655321 30163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:00:00.672439 30163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:00:00.677038 30163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:00:00.677352 30163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:00:00.677830 30163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:00:00.678407 30163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:00:00.678525 30163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:00.678610 30163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:00:00.678674 30163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:00.698630 30390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:33053 every 8 connection(s)
I20260812 21:00:00.698591 30163 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:33053
I20260812 21:00:00.699649 30163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:00:00.703966 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 30163
I20260812 21:00:00.704120 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:00:00.704381 10361 external_mini_cluster.cc:1428] Setting key 5225c62c2bc630c41722511c46a34648
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:00:00.715296 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:00.700830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:48173 (local address 127.10.30.126:45491)
0812 21:00:00.700897 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:00.700900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:00.701280 (+ 380us) server_negotiation.cc:407] Connection header received
0812 21:00:00.703366 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:00.703368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:00.703397 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:00.703482 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:00:00.704639 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:00.705365 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:00.706536 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:00.706771 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:00.706870 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:00.710474 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:00:00.710476 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:00:00.710477 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:00:00.710489 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:00:00.712830 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:00.713615 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:00.713617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:00.713617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:00.713704 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:00.714137 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:00.714139 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:00.714139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:00.714352 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:00:00.714449 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:00.714924 (+ 475us) server_negotiation.cc:299] Negotiation successful
0812 21:00:00.715120 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 21:00:00.715708 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:00.700798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45491 (local address 127.10.30.66:48173)
0812 21:00:00.701107 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:00.701167 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:00.703189 (+ 2022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:00.703605 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:00.703610 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:00.704084 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:00:00.704489 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:00.704496 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:00.705469 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:00.705470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:00.706417 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:00.706419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:00.706885 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:00.706887 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:00.707092 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:00.707785 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:00:00.707796 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:00:00.710316 (+ 2520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:00:00.712949 (+ 2633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:00:00.712972 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:00:00.712976 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:00:00.713498 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:00:00.713804 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:00:00.713806 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:00:00.713806 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:00:00.714009 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:00:00.714464 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:00:00.714473 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:00:00.714708 (+ 235us) client_negotiation.cc:769] Sending connection context
0812 21:00:00.714882 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 21:00:00.715223 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":190,"threads_started":1}
I20260812 21:00:00.716428 30391 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45491
I20260812 21:00:00.716588 30391 heartbeater.cc:464] Registering TS with master...
I20260812 21:00:00.716987 30391 heartbeater.cc:511] Master 127.10.30.126:45491 requested a full tablet report, sending...
I20260812 21:00:00.717541 29760 ts_manager.cc:194] Registered new tserver with Master: 58ad09d080c24fd4a7ee782fd0f00f21 (127.10.30.66:33053)
I20260812 21:00:00.718190 29760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:48173
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 21:00:00.751729 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:37333/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45491
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:00:00.905719 30399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:00:00.906123 30399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:00:00.906169 30399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:00:00.908525 30399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:00:00.908628 30399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:00:00.908681 30399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:00:00.911077 30399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.30.84:37333/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:00:00.911439 30399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:00:00.911821 30399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:00:00.918534 30412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:00:00.918624 30418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:00:00.918660 30410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:00:00.919252 30399 server_base.cc:1034] running on GCE node
I20260812 21:00:00.919545 30399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:00:00.919909 30399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:00:00.921116 30399 hybrid_clock.cc:648] HybridClock initialized: now 1786568400921090 us; error 44 us; skew 500 ppm
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:00:00.926786 30399 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:00:00.927678 30399 webserver.cc:460] Webserver started at http://127.10.30.67:38871/ using document root <none> and password file <none>
I20260812 21:00:00.928094 30399 fs_manager.cc:359] Metadata directory not provided
I20260812 21:00:00.928174 30399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:00:00.928359 30399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 21:00:00 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:00:00.946452 30399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "cf2fcf8e155c46f4b4213cdf74641230"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "4fce43a7e899957e9d20991c06932261"
server_key_iv: "0e7badca8937144fa71acb6a4ad1837b"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.947080 30399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "cf2fcf8e155c46f4b4213cdf74641230"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "4fce43a7e899957e9d20991c06932261"
server_key_iv: "0e7badca8937144fa71acb6a4ad1837b"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.951670 30399 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260812 21:00:00.988121 30431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:00.988510 30399 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.001s sys 0.000s
I20260812 21:00:00.988678 30399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "cf2fcf8e155c46f4b4213cdf74641230"
format_stamp: "Formatted at 2026-08-12 21:00:00 on dist-test-slave-h3ft"
server_key: "4fce43a7e899957e9d20991c06932261"
server_key_iv: "0e7badca8937144fa71acb6a4ad1837b"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:00.988854 30399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:00:01.011171 30399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:00:01.014251 30399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:00:01.014456 30399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:00:01.014801 30399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:00:01.015301 30399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:00:01.015352 30399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:01.015389 30399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:00:01.015407 30399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:01.030925 30399 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:41465
I20260812 21:00:01.032233 30635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:41465 every 8 connection(s)
I20260812 21:00:01.032909 30399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:00:01.042086 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 30399
I20260812 21:00:01.042254 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:00:01.042531 10361 external_mini_cluster.cc:1428] Setting key 65e4698dc2b3bf54b70ab3362cb9084b
Aug 12 21:00:01 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:00:01.050799 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.035299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:36271 (local address 127.10.30.126:45491)
0812 21:00:01.035364 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:01.035367 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:01.035998 (+ 631us) server_negotiation.cc:407] Connection header received
0812 21:00:01.036866 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:01.036868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:01.036885 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:01.036967 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:00:01.037981 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.038837 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.040632 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.040967 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.041018 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.046258 (+ 5240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:00:01.046260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:00:01.046261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:00:01.046272 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:00:01.048604 (+ 2332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:01.049313 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:01.049315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:01.049315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:01.049402 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:01.049829 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:01.049830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:01.049830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:01.050028 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:00:01.050113 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:01.050557 (+ 444us) server_negotiation.cc:299] Negotiation successful
0812 21:00:01.050680 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 21:00:01.051143 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.035300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45491 (local address 127.10.30.67:36271)
0812 21:00:01.035775 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:01.035837 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:01.036702 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:01.037085 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:01.037091 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:01.037460 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:00:01.037857 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.037864 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.038953 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.038955 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.040508 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.040512 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.041141 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.041142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.041330 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.042258 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:00:01.042271 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:00:01.046086 (+ 3815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:00:01.048727 (+ 2641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:00:01.048743 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:00:01.048747 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:00:01.049202 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:00:01.049499 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:00:01.049500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:00:01.049500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:00:01.049737 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:00:01.050116 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:00:01.050125 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:00:01.050360 (+ 235us) client_negotiation.cc:769] Sending connection context
0812 21:00:01.050501 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 21:00:01.050738 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":264,"threads_started":1}
I20260812 21:00:01.051847 30636 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45491
I20260812 21:00:01.051992 30636 heartbeater.cc:464] Registering TS with master...
I20260812 21:00:01.052273 30636 heartbeater.cc:511] Master 127.10.30.126:45491 requested a full tablet report, sending...
I20260812 21:00:01.052839 29760 ts_manager.cc:194] Registered new tserver with Master: cf2fcf8e155c46f4b4213cdf74641230 (127.10.30.67:41465)
I20260812 21:00:01.053398 29760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:36271
I20260812 21:00:01.055424 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:00:01.069921 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.059537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55422 (local address 127.10.30.126:45491)
0812 21:00:01.059614 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:01.059617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:01.060048 (+ 431us) server_negotiation.cc:407] Connection header received
0812 21:00:01.060118 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:01.060119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:01.060135 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:01.060207 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:00:01.061335 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.062213 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.063445 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.063785 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.063841 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.065991 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:00:01.065993 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:00:01.065994 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:00:01.066005 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:00:01.068263 (+ 2258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:01.068808 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:01.068809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:01.068810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:01.068892 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:01.069126 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:01.069127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:01.069128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:01.069303 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:00:01.069398 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:01.069673 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 21:00:01.069789 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 21:00:01.073263 29760 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:00:01.076278 29760 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:00:01.088629 30653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.080885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:43297 (local address 127.0.0.1:33152)
0812 21:00:01.082393 (+ 1508us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:01.082459 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:01.082578 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:01.083074 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:01.083078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:01.083082 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:00:01.083182 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.083185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.085101 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.085103 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.086657 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.086661 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.088215 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.088216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.088326 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.088345 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 21:00:01.088426 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 21:00:01.088509 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1447,"thread_start_us":177,"threads_started":1}
I20260812 21:00:01.089221 30659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.081528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33152 (local address 127.10.30.65:43297)
0812 21:00:01.082106 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:01.082115 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:01.082725 (+ 610us) server_negotiation.cc:407] Connection header received
0812 21:00:01.082782 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:01.082785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:01.082807 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:01.082890 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:00:01.083282 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.084978 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.086801 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.087696 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.087769 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.087844 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:01.089056 (+ 1212us) server_negotiation.cc:299] Negotiation successful
0812 21:00:01.089122 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":86,"threads_started":1}
I20260812 21:00:01.090569 30049 tablet_service.cc:1467] Processing CreateTablet for tablet d5a04128ceca4143909e89f6644c67bf (DEFAULT_TABLE table=test-table [id=c9362b93ec3a42528c2e8cc1bd8ddf31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:00:01.091169 30049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a04128ceca4143909e89f6644c67bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:00:01.098893 30670 tablet_bootstrap.cc:492] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311: Bootstrap starting.
I20260812 21:00:01.099812 30656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.081268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:33053 (local address 127.0.0.1:56650)
0812 21:00:01.087392 (+ 6124us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:01.087402 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:01.087460 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:01.091089 (+ 3629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:01.091091 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:01.091095 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:00:01.091173 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.091175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.096608 (+ 5433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.096611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.097892 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.097896 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.099513 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.099514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.099588 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.099593 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:00:01.099647 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 21:00:01.099705 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6086,"thread_start_us":120,"threads_started":1}
I20260812 21:00:01.100333 30666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.081735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56650 (local address 127.10.30.66:33053)
0812 21:00:01.082254 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:01.082260 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:01.087893 (+ 5633us) server_negotiation.cc:407] Connection header received
0812 21:00:01.087961 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:01.087965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:01.087988 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:01.088086 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:00:01.095154 (+ 7068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.096463 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.098152 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.099282 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.099365 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.099472 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:01.100129 (+ 657us) server_negotiation.cc:299] Negotiation successful
0812 21:00:01.100196 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":177,"threads_started":1}
I20260812 21:00:01.101679 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.080885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:41465 (local address 127.0.0.1:41802)
0812 21:00:01.087149 (+ 6264us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:01.087165 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:01.087242 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:01.097066 (+ 9824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:01.097068 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:01.097071 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:00:01.097131 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.097134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.098917 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.098918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.100150 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.100153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.101421 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.101422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.101499 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.101506 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 21:00:01.101537 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 21:00:01.101589 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6187,"mutex_wait_us":3,"thread_start_us":210,"threads_started":1}
I20260812 21:00:01.101570 30285 tablet_service.cc:1467] Processing CreateTablet for tablet d5a04128ceca4143909e89f6644c67bf (DEFAULT_TABLE table=test-table [id=c9362b93ec3a42528c2e8cc1bd8ddf31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:00:01.102136 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.083654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41802 (local address 127.10.30.67:41465)
0812 21:00:01.096810 (+ 13156us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:01.096818 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:01.096833 (+ 15us) server_negotiation.cc:407] Connection header received
0812 21:00:01.096886 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:01.096888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:01.096913 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:01.097221 (+ 308us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:00:01.097328 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.098801 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.100348 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.101286 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.101821 (+ 535us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.101949 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:01.101980 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 21:00:01.102027 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13090,"thread_start_us":160,"threads_started":1}
I20260812 21:00:01.102130 30285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a04128ceca4143909e89f6644c67bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:00:01.106644 30512 tablet_service.cc:1467] Processing CreateTablet for tablet d5a04128ceca4143909e89f6644c67bf (DEFAULT_TABLE table=test-table [id=c9362b93ec3a42528c2e8cc1bd8ddf31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:00:01.107280 30512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a04128ceca4143909e89f6644c67bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:00:01.112664 30671 tablet_bootstrap.cc:492] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Bootstrap starting.
I20260812 21:00:01.114535 30671 tablet_bootstrap.cc:654] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Neither blocks nor log segments found. Creating new log.
I20260812 21:00:01.114758 30670 tablet_bootstrap.cc:654] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311: Neither blocks nor log segments found. Creating new log.
I20260812 21:00:01.115180 30671 log.cc:824] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Log is configured to *not* fsync() on all Append() calls
I20260812 21:00:01.115545 30670 log.cc:824] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311: Log is configured to *not* fsync() on all Append() calls
I20260812 21:00:01.115798 30675 tablet_bootstrap.cc:492] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Bootstrap starting.
I20260812 21:00:01.117926 30675 tablet_bootstrap.cc:654] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Neither blocks nor log segments found. Creating new log.
I20260812 21:00:01.118646 30675 log.cc:824] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Log is configured to *not* fsync() on all Append() calls
I20260812 21:00:01.119916 30671 tablet_bootstrap.cc:492] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: No bootstrap required, opened a new log
I20260812 21:00:01.120010 30671 ts_tablet_manager.cc:1397] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260812 21:00:01.120249 30670 tablet_bootstrap.cc:492] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311: No bootstrap required, opened a new log
I20260812 21:00:01.120328 30670 ts_tablet_manager.cc:1397] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.003s
I20260812 21:00:01.123063 30671 raft_consensus.cc:348] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.123309 30671 raft_consensus.cc:374] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:00:01.123345 30671 raft_consensus.cc:729] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ad09d080c24fd4a7ee782fd0f00f21, State: Initialized, Role: FOLLOWER
I20260812 21:00:01.123777 30671 consensus_queue.cc:260] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.124303 30671 ts_tablet_manager.cc:1428] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 21:00:01.124519 30391 heartbeater.cc:503] Master 127.10.30.126:45491 was elected leader, sending a full tablet report...
I20260812 21:00:01.124454 30670 raft_consensus.cc:348] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.124668 30670 raft_consensus.cc:374] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:00:01.124709 30670 raft_consensus.cc:729] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adbe24cbe13345a6b213abefaae71311, State: Initialized, Role: FOLLOWER
I20260812 21:00:01.124852 30670 consensus_queue.cc:260] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.125133 30675 tablet_bootstrap.cc:492] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: No bootstrap required, opened a new log
I20260812 21:00:01.125175 30670 ts_tablet_manager.cc:1428] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260812 21:00:01.125231 30675 ts_tablet_manager.cc:1397] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.001s
I20260812 21:00:01.125312 30153 heartbeater.cc:503] Master 127.10.30.126:45491 was elected leader, sending a full tablet report...
I20260812 21:00:01.128736 30675 raft_consensus.cc:348] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.129215 30675 raft_consensus.cc:374] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:00:01.129303 30675 raft_consensus.cc:729] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2fcf8e155c46f4b4213cdf74641230, State: Initialized, Role: FOLLOWER
I20260812 21:00:01.129514 30675 consensus_queue.cc:260] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.130010 30636 heartbeater.cc:503] Master 127.10.30.126:45491 was elected leader, sending a full tablet report...
I20260812 21:00:01.129999 30675 ts_tablet_manager.cc:1428] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
Aug 12 21:00:01 dist-test-slave-h3ft krb5kdc[28889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568400, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
W20260812 21:00:01.201068 30392 tablet.cc:2369] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:00:01.284725 30638 tablet.cc:2369] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:00:01.361754 30154 tablet.cc:2369] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:00:01.410037 30680 raft_consensus.cc:482] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:00:01.410288 30680 raft_consensus.cc:504] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.410881 30680 leader_election.cc:288] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2fcf8e155c46f4b4213cdf74641230 (127.10.30.67:41465), adbe24cbe13345a6b213abefaae71311 (127.10.30.65:43297)
I20260812 21:00:01.415802 30659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.411436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:46955 (local address 127.10.30.65:43297)
0812 21:00:01.411503 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:01.411505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:01.411681 (+ 176us) server_negotiation.cc:407] Connection header received
0812 21:00:01.411804 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:01.411805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:01.411819 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:01.411851 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:00:01.412113 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.412914 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.414572 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.415268 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.415335 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.415349 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:01.415638 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 21:00:01.415699 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 21:00:01.415861 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.411391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:36071 (local address 127.10.30.67:41465)
0812 21:00:01.411465 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:01.411468 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:01.411683 (+ 215us) server_negotiation.cc:407] Connection header received
0812 21:00:01.411828 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:01.411829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:01.411847 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:01.411885 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:00:01.412155 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.412931 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.414525 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.415379 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.415447 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.415459 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:01.415716 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 21:00:01.415773 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 21:00:01.416188 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.411157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:41465 (local address 127.10.30.66:36071)
0812 21:00:01.411584 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:01.411601 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:01.411719 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:01.411976 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:01.411977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:01.411979 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:00:01.412064 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.412067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.413094 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.413095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.414359 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.414363 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.415529 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.415531 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.415625 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.415630 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:00:01.416022 (+ 392us) client_negotiation.cc:240] Negotiation successful
0812 21:00:01.416085 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":45,"thread_start_us":90,"threads_started":1}
I20260812 21:00:01.416797 30525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a04128ceca4143909e89f6644c67bf" candidate_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2fcf8e155c46f4b4213cdf74641230" is_pre_election: true
I20260812 21:00:01.417060 30525 raft_consensus.cc:2454] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ad09d080c24fd4a7ee782fd0f00f21 in term 0.
I20260812 21:00:01.416579 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.411206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:43297 (local address 127.10.30.66:46955)
0812 21:00:01.411592 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:01.411603 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:01.411718 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:01.411936 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:01.411937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:01.411939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:00:01.412034 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.412037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.413033 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.413034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.414409 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:01.414412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.415422 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.415423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:01.415543 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.415548 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:00:01.416410 (+ 862us) client_negotiation.cc:240] Negotiation successful
0812 21:00:01.416479 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":67,"threads_started":1}
I20260812 21:00:01.417407 30199 leader_election.cc:302] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ad09d080c24fd4a7ee782fd0f00f21, cf2fcf8e155c46f4b4213cdf74641230; no voters:
I20260812 21:00:01.417488 30080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a04128ceca4143909e89f6644c67bf" candidate_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adbe24cbe13345a6b213abefaae71311" is_pre_election: true
I20260812 21:00:01.417608 30680 raft_consensus.cc:2781] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:00:01.417659 30680 raft_consensus.cc:482] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:00:01.417658 30080 raft_consensus.cc:2454] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ad09d080c24fd4a7ee782fd0f00f21 in term 0.
I20260812 21:00:01.417685 30680 raft_consensus.cc:3037] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:00:01.419319 30680 raft_consensus.cc:504] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.419528 30680 leader_election.cc:288] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [CANDIDATE]: Term 1 election: Requested vote from peers cf2fcf8e155c46f4b4213cdf74641230 (127.10.30.67:41465), adbe24cbe13345a6b213abefaae71311 (127.10.30.65:43297)
I20260812 21:00:01.419755 30080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a04128ceca4143909e89f6644c67bf" candidate_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adbe24cbe13345a6b213abefaae71311"
I20260812 21:00:01.419787 30525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a04128ceca4143909e89f6644c67bf" candidate_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2fcf8e155c46f4b4213cdf74641230"
I20260812 21:00:01.419857 30080 raft_consensus.cc:3037] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:00:01.419895 30525 raft_consensus.cc:3037] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:00:01.420976 30080 raft_consensus.cc:2454] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ad09d080c24fd4a7ee782fd0f00f21 in term 1.
I20260812 21:00:01.421280 30525 raft_consensus.cc:2454] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ad09d080c24fd4a7ee782fd0f00f21 in term 1.
I20260812 21:00:01.421537 30199 leader_election.cc:302] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ad09d080c24fd4a7ee782fd0f00f21, cf2fcf8e155c46f4b4213cdf74641230; no voters:
I20260812 21:00:01.421633 30680 raft_consensus.cc:2781] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:00:01.421828 30680 raft_consensus.cc:686] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 1 LEADER]: Becoming Leader. State: Replica: 58ad09d080c24fd4a7ee782fd0f00f21, State: Running, Role: LEADER
I20260812 21:00:01.421998 30680 consensus_queue.cc:237] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } }
I20260812 21:00:01.423149 29760 catalog_manager.cc:5495] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ad09d080c24fd4a7ee782fd0f00f21 (127.10.30.66). New cstate: current_term: 1 leader_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ad09d080c24fd4a7ee782fd0f00f21" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 } health_report { overall_health: UNKNOWN } } }
I20260812 21:00:01.451990 30666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.447745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56656 (local address 127.10.30.66:33053)
0812 21:00:01.447842 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:01.447845 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:01.447855 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:00:01.447913 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:01.447914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:01.447948 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:01.448032 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:00:01.448274 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.449005 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.450249 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:01.450670 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:01.450769 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:01.451340 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:00:01.451547 (+ 207us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:00:01.451652 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:01.451770 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 21:00:01.451809 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 21:00:01.455288 30080 raft_consensus.cc:1261] T d5a04128ceca4143909e89f6644c67bf P adbe24cbe13345a6b213abefaae71311 [term 1 FOLLOWER]: Refusing update from remote peer 58ad09d080c24fd4a7ee782fd0f00f21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:00:01.455487 30525 raft_consensus.cc:1261] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 1 FOLLOWER]: Refusing update from remote peer 58ad09d080c24fd4a7ee782fd0f00f21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:00:01.456532 30680 consensus_queue.cc:1035] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2fcf8e155c46f4b4213cdf74641230" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:00:01.459406 30680 consensus_queue.cc:1035] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adbe24cbe13345a6b213abefaae71311" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 43297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:00:01.462718 30694 mvcc.cc:205] Tried to move back new op lower bound from 7317784172354887680 to 7317784172225241088. Current Snapshot: MvccSnapshot[applied={T|T < 7317784172354887680}]
I20260812 21:00:01.463830 30696 mvcc.cc:205] Tried to move back new op lower bound from 7317784172354887680 to 7317784172225241088. Current Snapshot: MvccSnapshot[applied={T|T < 7317784172354887680}]
I20260812 21:00:01.467305 29760 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:00:01.467468 29760 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:00:01.469254 29760 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09c212f37ace44caa2a88b0573d31fb6: Sending DeleteTablet for 3 replicas of tablet d5a04128ceca4143909e89f6644c67bf
I20260812 21:00:01.469853 30285 tablet_service.cc:1514] Processing DeleteTablet for tablet d5a04128ceca4143909e89f6644c67bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:00:01 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:56650
I20260812 21:00:01.470301 30049 tablet_service.cc:1514] Processing DeleteTablet for tablet d5a04128ceca4143909e89f6644c67bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:00:01 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:33152
I20260812 21:00:01.470618 30512 tablet_service.cc:1514] Processing DeleteTablet for tablet d5a04128ceca4143909e89f6644c67bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:00:01 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:41802
I20260812 21:00:01.470709 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 29916
I20260812 21:00:01.479224 30710 tablet_replica.cc:330] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: stopping tablet replica
I20260812 21:00:01.482481 30710 raft_consensus.cc:2229] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:00:01.482815 30710 raft_consensus.cc:2258] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:00:01.491568 30710 ts_tablet_manager.cc:1905] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:00:01.497282 30710 ts_tablet_manager.cc:1918] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:00:01.500161 30710 log.cc:1196] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/d5a04128ceca4143909e89f6644c67bf
I20260812 21:00:01.500710 30710 ts_tablet_manager.cc:1939] T d5a04128ceca4143909e89f6644c67bf P 58ad09d080c24fd4a7ee782fd0f00f21: Deleting consensus metadata
I20260812 21:00:01.506894 29731 catalog_manager.cc:4841] TS 58ad09d080c24fd4a7ee782fd0f00f21 (127.10.30.66:33053): tablet d5a04128ceca4143909e89f6644c67bf (table test-table [id=c9362b93ec3a42528c2e8cc1bd8ddf31]) successfully deleted
I20260812 21:00:01.511099 30714 tablet_replica.cc:330] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: stopping tablet replica
I20260812 21:00:01.511454 30714 raft_consensus.cc:2229] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:00:01.511678 30714 raft_consensus.cc:2258] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:00:01.512437 30714 ts_tablet_manager.cc:1905] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:00:01.514802 30714 ts_tablet_manager.cc:1918] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:00:01.514936 30714 log.cc:1196] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/d5a04128ceca4143909e89f6644c67bf
I20260812 21:00:01.515290 30714 ts_tablet_manager.cc:1939] T d5a04128ceca4143909e89f6644c67bf P cf2fcf8e155c46f4b4213cdf74641230: Deleting consensus metadata
I20260812 21:00:01.515950 29731 catalog_manager.cc:4841] TS cf2fcf8e155c46f4b4213cdf74641230 (127.10.30.67:41465): tablet d5a04128ceca4143909e89f6644c67bf (table test-table [id=c9362b93ec3a42528c2e8cc1bd8ddf31]) successfully deleted
I20260812 21:00:01.519946 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 30163
W20260812 21:00:01.542171 29729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:43297 (error 108)
I20260812 21:00:01.546386 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:01.546149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:43297 (local address 127.0.0.1:33166)
0812 21:00:01.546226 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:01.546317 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:43297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 21:00:01.546630 29729 catalog_manager.cc:4584] TS adbe24cbe13345a6b213abefaae71311 (127.10.30.65:43297): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d5a04128ceca4143909e89f6644c67bf: Network error: Client connection negotiation failed: client connection to 127.10.30.65:43297: connect: Connection refused (error 111)
I20260812 21:00:01.553726 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 30399
I20260812 21:00:01.587960 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 29705
I20260812 21:00:01.651255 10361 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 21:00:02.010848 10361 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 21:00:02.011152 10361 mini_ranger.cc:66] Stopping Ranger...
I20260812 21:00:02.379236 10361 mini_ranger.cc:68] Stopped Ranger
2026-08-12 21:00:02.379 UTC [28937] LOG: received smart shutdown request
2026-08-12 21:00:02.384 UTC [28937] LOG: background worker "logical replication launcher" (PID 28956) exited with exit code 1
2026-08-12 21:00:02.385 UTC [28944] LOG: shutting down
2026-08-12 21:00:02.618 UTC [28937] LOG: database system is shut down
2026-08-12T21:00:02Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (58428 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:00:02 dist-test-slave-h3ft krb5kdc[30731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:00:02 dist-test-slave-h3ft krb5kdc[30731](info): set up 2 sockets
Aug 12 21:00:02 dist-test-slave-h3ft krb5kdc[30731](info): commencing operation
krb5kdc: starting...
W20260812 21:00:04.164098 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.377s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:00:04 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:00:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:00:04Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.30.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.30.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/rangeradmin_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/rangeradmin_127.10.30.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.30.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.30.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/rangerlookup_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/rangerlookup_127.10.30.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.30.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.30.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/HTTP_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/HTTP_127.10.30.84@KRBTEST.COM.keytab.
I20260812 21:00:04.400159 10361 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskDgHCG3/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/postgres -l logfile start
2026-08-12 21:00:07.688 UTC [30780] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 21:00:07.689 UTC [30780] LOG: listening on IPv4 address "127.10.30.84", port 43127
2026-08-12 21:00:07.695 UTC [30780] LOG: listening on Unix socket "/tmp/.s.PGSQL.43127"
2026-08-12 21:00:07.720 UTC [30786] LOG: database system was shut down at 2026-08-12 21:00:05 UTC
2026-08-12 21:00:07.726 UTC [30780] LOG: database system is ready to accept connections
I20260812 21:00:08.995590 10361 mini_postgres.cc:96] Postgres bound to 43127
2026-08-12 21:00:09.005 UTC [30799] FATAL: database "slave" does not exist
127.10.30.84:43127 - accepting connections
I20260812 21:00:09.005960 10361 mini_ranger.cc:161] Starting Ranger...
I20260812 21:00:09.028035 10361 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 21:00:09.704321 10361 mini_ranger.cc:87] Created ranger Postgres database
I20260812 21:00:09.704432 10361 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-admin
2026-08-12 21:00:10,060 [I] DB FLAVOR :POSTGRES
2026-08-12 21:00:10,061 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 21:00:10,061 [I] Checking connection..
2026-08-12 21:00:10,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 21:00:10,378 [I] Checking connection passed.
2026-08-12 21:00:10,379 [I] --------- Verifying version history table ---------
2026-08-12 21:00:10,379 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 21:00:10,667 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 21:00:10,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 21:00:11,008 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 21:00:11,008 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 21:00:11,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 21:00:11.318 UTC [30917] WARNING: there is no transaction in progress
2026-08-12 21:00:11,331 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 21:00:11,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 21:00:11,672 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 21:00:11,673 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 21:00:11,673 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 21:00:12,005 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 21:00:12,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-h3ft.c.gcp-upstream.internal','N') ;"
2026-08-12 21:00:12,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 21:00:12,972 [I] Table x_portal_user does not exist in database ranger
2026-08-12 21:00:12,972 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 21:00:13,299 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 21:00:13,299 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 21:00:13,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 21:00:13,942 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 21:00:13,942 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 21:00:15.342 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.366 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.388 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.410 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.432 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.458 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.546 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.558 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.580 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.594 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.610 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.629 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.644 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.655 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.665 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:15.675 UTC [31101] WARNING: there is no transaction in progress
2026-08-12 21:00:16,667 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 21:00:16,668 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 21:00:16,976 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 21:00:16,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 21:00:17,298 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 21:00:17,299 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 21:00:17,635 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 21:00:17,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 21:00:17,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 21:00:18,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-h3ft.c.gcp-upstream.internal';"
2026-08-12 21:00:18,595 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 21:00:18,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 21:00:18,929 [I] DB_PATCHES have already been applied
I20260812 21:00:18.940825 10361 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-admin:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskDgHCG3/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 21:00:18.941052 10361 mini_ranger.cc:193] Using host: 127.10.30.84
I20260812 21:00:18.946530 10361 mini_ranger.cc:227] Ranger admin URL: http://127.10.30.84:41601
Aug 12, 2026 9:00:19 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 9:00:19 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 9:00:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 9:00:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 9:00:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 9:00:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 9:00:19 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 21:00:20.508062 10361 mini_ranger.cc:160] Time spent starting Ranger: real 11.502s user 0.004s sys 0.011s
Aug 12, 2026 9:00:45 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 9:00:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 9:00:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 9:00:45 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 9:00:46 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 21:00:47.585945 10361 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.30.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.30.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/rangerkms_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.30.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/rangerkms_127.10.30.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.30.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.30.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.30.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/HTTP_127.10.30.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.30.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/HTTP_127.10.30.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 21:00:47 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568447, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 21:00:47.702299 10361 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 21:00:47.718940 10361 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 21:00:48.975149 10361 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 21:00:48.975272 10361 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms
I20260812 21:00:48.975296 10361 mini_ranger_kms.cc:227] Using postgres at 127.10.30.84:43127
2026-08-12 21:00:49,208 [I] DB FLAVOR :POSTGRES
2026-08-12 21:00:49,209 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 21:00:49,209 [I] Checking connection
2026-08-12 21:00:49,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 21:00:49,495 [I] connection success
2026-08-12 21:00:49,496 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 21:00:49,496 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 21:00:49,496 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 21:00:49,800 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 21:00:49,801 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 21:00:49,801 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 21:00:49,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.30.84:43127/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 21:00:50,147 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 21:00:50.774232 10361 mini_ranger_kms.cc:310] Created kms service
I20260812 21:00:51.022558 10361 mini_ranger_kms.cc:326] Created kudu user
I20260812 21:00:51.077261 10361 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 21:00:51 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568447, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:00:51.577409 10361 mini_ranger_kms.cc:384] Added ranger policy
I20260812 21:00:51.577576 10361 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms:/tmp/dist-test-taskDgHCG3/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskDgHCG3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 21:00:51.577595 10361 mini_ranger_kms.cc:240] Using host: 127.10.30.84
I20260812 21:00:51.584240 10361 mini_ranger_kms.cc:276] Ranger KMS PID: 31412
I20260812 21:00:51.584385 10361 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.30.84:47469
Aug 12, 2026 9:00:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 9:00:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 9:00:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 9:00:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 9:00:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 9:00:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 21:00:54 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786568454, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.30.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:00:54.681921 10361 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.980s user 0.000s sys 0.216s
I20260812 21:00:54.682082 10361 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 21:00:54.682149 10361 mini_ranger_kms.cc:401] 127.10.30.84:47469/kms/v1/keys
Aug 12 21:00:55 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568454, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.30.84@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
Aug 12 21:00:55 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568454, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.30.84@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
Aug 12 21:00:58 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:00:58.484124 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:45737
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:45737
--ranger_config_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:47469/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:00:58.597739 31498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:00:58.598004 31498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:00:58.598028 31498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:00:58.599468 31498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:00:58.599522 31498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:00:58.599536 31498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:00:58.599551 31498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:00:58.599565 31498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:00:58.601334 31498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.30.84:47469/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:45737
--ranger_config_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:45737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:00:58.601637 31498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:00:58.601943 31498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:00:58.608294 31514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:00:58.608280 31512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:00:58.608424 31498 server_base.cc:1034] running on GCE node
W20260812 21:00:58.608276 31516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:00:58.609110 31498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:00:58.609550 31498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:00:58.610749 31498 hybrid_clock.cc:648] HybridClock initialized: now 1786568458610718 us; error 47 us; skew 500 ppm
Aug 12 21:00:58 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568458, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:00:58.619406 31498 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:00:58.620088 31498 webserver.cc:460] Webserver started at http://127.10.30.126:37085/ using document root <none> and password file <none>
I20260812 21:00:58.620368 31498 fs_manager.cc:359] Metadata directory not provided
I20260812 21:00:58.620414 31498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:00:58.620572 31498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 21:00:58 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568458, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:00:58.678030 31498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94"
format_stamp: "Formatted at 2026-08-12 21:00:58 on dist-test-slave-h3ft"
server_key: "99f66c36994f9ae184f38b6760219026"
server_key_iv: "f9619f78920421cf69fd00eefbb20010"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:58.678588 31498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94"
format_stamp: "Formatted at 2026-08-12 21:00:58 on dist-test-slave-h3ft"
server_key: "99f66c36994f9ae184f38b6760219026"
server_key_iv: "f9619f78920421cf69fd00eefbb20010"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:58.680540 31498 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:00:58.696765 31524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:58.697045 31498 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:00:58.697199 31498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94"
format_stamp: "Formatted at 2026-08-12 21:00:58 on dist-test-slave-h3ft"
server_key: "99f66c36994f9ae184f38b6760219026"
server_key_iv: "f9619f78920421cf69fd00eefbb20010"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:58.697341 31498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:00:58.705847 31498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:00:58.708179 31498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:00:58.708379 31498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:00:58.714414 31498 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:45737
I20260812 21:00:58.714486 31617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:45737 every 8 connection(s)
I20260812 21:00:58.714933 31498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:00:58.715955 31619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:00:58.719705 31619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Bootstrap starting.
I20260812 21:00:58.720585 31619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Neither blocks nor log segments found. Creating new log.
I20260812 21:00:58.720988 31619 log.cc:824] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Log is configured to *not* fsync() on all Append() calls
I20260812 21:00:58.721944 31619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: No bootstrap required, opened a new log
I20260812 21:00:58.724431 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 31498
I20260812 21:00:58.724586 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:00:58.724822 10361 external_mini_cluster.cc:1428] Setting key b3dc461cb365b0cbaed9a14d4a0bba0c
I20260812 21:00:58.725340 31619 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } }
I20260812 21:00:58.725595 31619 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:00:58.725641 31619 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41b7f74bb5474fdf831b6cf1fcf1ad94, State: Initialized, Role: FOLLOWER
I20260812 21:00:58.725818 31619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } }
I20260812 21:00:58.725908 31619 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:00:58.725950 31619 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:00:58.726001 31619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:00:58.726900 31619 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } }
I20260812 21:00:58.727065 31619 leader_election.cc:302] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41b7f74bb5474fdf831b6cf1fcf1ad94; no voters:
I20260812 21:00:58.727272 31619 leader_election.cc:288] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:00:58.727334 31626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:00:58.727522 31626 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 1 LEADER]: Becoming Leader. State: Replica: 41b7f74bb5474fdf831b6cf1fcf1ad94, State: Running, Role: LEADER
I20260812 21:00:58.727604 31619 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:00:58.727648 31626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } }
I20260812 21:00:58.728027 31626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } } }
I20260812 21:00:58.728111 31626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: This master's current role is: LEADER
I20260812 21:00:58.728281 31626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41b7f74bb5474fdf831b6cf1fcf1ad94. Latest consensus state: current_term: 1 leader_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } } }
I20260812 21:00:58.728343 31626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: This master's current role is: LEADER
I20260812 21:00:58.728680 31637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:00:58.729262 31637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:00:58.729574 31619 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 21:00:58.738118 31637 catalog_manager.cc:1347] Generated new cluster ID: 365e29be9af143c08ddbd390c3ea298a
I20260812 21:00:58.738292 31637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 21:00:58 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:00:58.743026 31637 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:00:58.744076 31637 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:00:58.744882 31625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:58.725545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47032 (local address 127.10.30.126:45737)
0812 21:00:58.725811 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:58.725824 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:58.726052 (+ 228us) server_negotiation.cc:407] Connection header received
0812 21:00:58.726191 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:58.726198 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:58.726255 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:58.726416 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:00:58.727230 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:58.729486 (+ 2256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:58.730844 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:58.735493 (+ 4649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:58.738203 (+ 2710us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:58.739341 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:00:58.739347 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:00:58.739348 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:00:58.739364 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:00:58.741932 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:58.742418 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:58.742422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:58.742423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:58.742560 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:58.742773 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:58.742774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:58.742774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:58.743287 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:00:58.744055 (+ 768us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:58.744201 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 21:00:58.744539 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":122,"threads_started":1}
I20260812 21:00:58.751701 31637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Generated new TSK 0
I20260812 21:00:58.751932 31637 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 21:00:59.636071 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:47469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45737
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:00:59.764024 31688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:00:59.764384 31688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:00:59.764431 31688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:00:59.766577 31688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:00:59.766664 31688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:00:59.766714 31688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:00:59.768747 31688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.30.84:47469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:00:59.769093 31688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:00:59.769411 31688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:00:59.775362 31705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:00:59.775373 31702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:00:59.775779 31708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:00:59.776062 31688 server_base.cc:1034] running on GCE node
I20260812 21:00:59.776307 31688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:00:59.776656 31688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:00:59.777832 31688 hybrid_clock.cc:648] HybridClock initialized: now 1786568459777802 us; error 50 us; skew 500 ppm
Aug 12 21:00:59 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568459, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:00:59.781291 31688 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:00:59.782059 31688 webserver.cc:460] Webserver started at http://127.10.30.65:41915/ using document root <none> and password file <none>
I20260812 21:00:59.782393 31688 fs_manager.cc:359] Metadata directory not provided
I20260812 21:00:59.782476 31688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:00:59.782639 31688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 21:00:59 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568459, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:00:59.802301 31688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "18992c98fd71432b9980107ee6bbc020"
format_stamp: "Formatted at 2026-08-12 21:00:59 on dist-test-slave-h3ft"
server_key: "b5bfb09bfba9a3cbd2cbf2618a26721c"
server_key_iv: "4bcdc7c07f2ed44e40764024b2bb632f"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:59.803023 31688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "18992c98fd71432b9980107ee6bbc020"
format_stamp: "Formatted at 2026-08-12 21:00:59 on dist-test-slave-h3ft"
server_key: "b5bfb09bfba9a3cbd2cbf2618a26721c"
server_key_iv: "4bcdc7c07f2ed44e40764024b2bb632f"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:59.805657 31688 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 21:00:59.831265 31719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:59.831661 31688 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260812 21:00:59.831810 31688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "18992c98fd71432b9980107ee6bbc020"
format_stamp: "Formatted at 2026-08-12 21:00:59 on dist-test-slave-h3ft"
server_key: "b5bfb09bfba9a3cbd2cbf2618a26721c"
server_key_iv: "4bcdc7c07f2ed44e40764024b2bb632f"
server_key_version: "kuduclusterkey@0"
I20260812 21:00:59.832024 31688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:00:59.845044 31688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:00:59.847818 31688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:00:59.848037 31688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:00:59.848389 31688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:00:59.848860 31688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:00:59.848917 31688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:59.848965 31688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:00:59.848989 31688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:00:59.857954 31688 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:38341
I20260812 21:00:59.858439 31688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:00:59.859205 31897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:38341 every 8 connection(s)
Aug 12 21:00:59 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568459, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:00:59.867719 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 31688
I20260812 21:00:59.867858 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:00:59.868136 10361 external_mini_cluster.cc:1428] Setting key 9f959ab1d18389e1f8e1d84ba00c5836
I20260812 21:00:59.873051 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:59.859458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:59249 (local address 127.10.30.126:45737)
0812 21:00:59.859656 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 21:00:59.859660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:00:59.860005 (+ 345us) server_negotiation.cc:407] Connection header received
0812 21:00:59.860693 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:00:59.860695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:00:59.860716 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:00:59.860804 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:00:59.861528 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:59.862137 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:59.863359 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:00:59.863598 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:00:59.863706 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:59.866942 (+ 3236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:00:59.866948 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:00:59.866948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:00:59.866962 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:00:59.869100 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:59.871811 (+ 2711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:59.871814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:59.871814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:59.871901 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:00:59.872212 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:00:59.872213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:00:59.872214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:00:59.872369 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:00:59.872449 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:00:59.872808 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 21:00:59.872928 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":89,"threads_started":1}
I20260812 21:00:59.873309 31906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:00:59.859453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45737 (local address 127.10.30.65:59249)
0812 21:00:59.859834 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0812 21:00:59.859893 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 21:00:59.860564 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:00:59.860896 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:00:59.860901 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:00:59.861170 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:00:59.861416 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:59.861421 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:59.862258 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:59.862259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:59.863260 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:00:59.863264 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:00:59.863736 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:00:59.863737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:00:59.863878 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:00:59.864689 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:00:59.864702 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:00:59.866748 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:00:59.871123 (+ 4375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:00:59.871140 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:00:59.871144 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:00:59.871698 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:00:59.871976 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:00:59.871977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:00:59.871978 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:00:59.872141 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:00:59.872447 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:00:59.872456 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:00:59.872653 (+ 197us) client_negotiation.cc:769] Sending connection context
0812 21:00:59.872772 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 21:00:59.873001 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":103,"threads_started":1}
I20260812 21:00:59.874229 31898 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45737
I20260812 21:00:59.874373 31898 heartbeater.cc:464] Registering TS with master...
I20260812 21:00:59.874612 31898 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:00:59.875341 31549 ts_manager.cc:194] Registered new tserver with Master: 18992c98fd71432b9980107ee6bbc020 (127.10.30.65:38341)
I20260812 21:00:59.876204 31549 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:59249
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 21:00:59.916256 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:47469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45737
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 21:01:00.066727 31911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:00.067158 31911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:00.067211 31911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:00.069578 31911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:00.069691 31911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:00.069744 31911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:01:00.072757 31911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.30.84:47469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:00.073165 31911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:00.073586 31911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:00.081271 31922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:00.081369 31927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:00.081271 31924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:00.083289 31911 server_base.cc:1034] running on GCE node
I20260812 21:01:00.083640 31911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:00.084049 31911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:00.085278 31911 hybrid_clock.cc:648] HybridClock initialized: now 1786568460085245 us; error 52 us; skew 500 ppm
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:00.089910 31911 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:01:00.090775 31911 webserver.cc:460] Webserver started at http://127.10.30.66:44981/ using document root <none> and password file <none>
I20260812 21:01:00.091187 31911 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:00.091281 31911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:00.091480 31911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:01:00.115753 31911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "23da957163de4ad49af253affb2ccda0"
format_stamp: "Formatted at 2026-08-12 21:01:00 on dist-test-slave-h3ft"
server_key: "2c9bd96e0d1ee74b672125a1d95a19f4"
server_key_iv: "e259bb8ec453100e7e4c9f21ea379aee"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:00.116441 31911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "23da957163de4ad49af253affb2ccda0"
format_stamp: "Formatted at 2026-08-12 21:01:00 on dist-test-slave-h3ft"
server_key: "2c9bd96e0d1ee74b672125a1d95a19f4"
server_key_iv: "e259bb8ec453100e7e4c9f21ea379aee"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:00.118857 31911 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 21:01:00.143286 31939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:00.143579 31911 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:00.143698 31911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "23da957163de4ad49af253affb2ccda0"
format_stamp: "Formatted at 2026-08-12 21:01:00 on dist-test-slave-h3ft"
server_key: "2c9bd96e0d1ee74b672125a1d95a19f4"
server_key_iv: "e259bb8ec453100e7e4c9f21ea379aee"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:00.143828 31911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:00.156919 31911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:00.160522 31911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:00.160678 31911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:00.161048 31911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:00.161499 31911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:00.161556 31911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:00.161597 31911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:00.161625 31911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:00.170922 31911 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:43787
I20260812 21:01:00.171118 32131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:43787 every 8 connection(s)
I20260812 21:01:00.171517 31911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:01:00.177532 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 31911
I20260812 21:01:00.177697 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:01:00.177974 10361 external_mini_cluster.cc:1428] Setting key 06b1f3442734cd614d0b0f8bf37033de
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:00.186158 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:00.172894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:45563 (local address 127.10.30.126:45737)
0812 21:01:00.172992 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:00.172995 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:00.173352 (+ 357us) server_negotiation.cc:407] Connection header received
0812 21:01:00.174160 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:00.174162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:00.174186 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:00.174289 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:00.175244 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:00.176104 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:00.177864 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:00.178227 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:00.178279 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:00.181554 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:00.181556 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:00.181557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:00.181567 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:00.184050 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:00.184730 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:00.184732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:00.184732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:00.184813 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:00.185167 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:00.185168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:00.185168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:00.185349 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:00.185404 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:00.185883 (+ 479us) server_negotiation.cc:299] Negotiation successful
0812 21:01:00.186013 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 21:01:00.187292 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:00.172874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45737 (local address 127.10.30.66:45563)
0812 21:01:00.173189 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:00.173240 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:00.174017 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:00.174386 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:00.174391 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:00.174703 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:00.175119 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:00.175128 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:00.176238 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:00.176239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:00.177737 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:00.177741 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:00.178409 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:00.178410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:00.178584 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:00.179419 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:00.179432 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:00.181411 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:00.184177 (+ 2766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:00.184189 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:00.184194 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:00.184619 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:00.184910 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:00.184911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:00.184911 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:00.185083 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:00.185459 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:00.185467 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:00.185685 (+ 218us) client_negotiation.cc:769] Sending connection context
0812 21:01:00.186670 (+ 985us) client_negotiation.cc:240] Negotiation successful
0812 21:01:00.186923 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":107,"threads_started":1}
I20260812 21:01:00.188246 32133 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45737
I20260812 21:01:00.188374 32133 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:00.188637 32133 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:01:00.189241 31549 ts_manager.cc:194] Registered new tserver with Master: 23da957163de4ad49af253affb2ccda0 (127.10.30.66:43787)
I20260812 21:01:00.189813 31549 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:45563
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 21:01:00.223654 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:47469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45737
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:00.375748 32140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:00.376077 32140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:00.376127 32140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:00.377578 32140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:00.377643 32140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:00.377693 32140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:01:00.379673 32140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.30.84:47469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:45737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:00.379998 32140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:00.380298 32140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:00.388818 32150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:00.389434 32154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:00.391969 32157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:00.393107 32140 server_base.cc:1034] running on GCE node
I20260812 21:01:00.393400 32140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:00.393774 32140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:00.397081 32140 hybrid_clock.cc:648] HybridClock initialized: now 1786568460397047 us; error 46 us; skew 500 ppm
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:00.402248 32140 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:01:00.402969 32140 webserver.cc:460] Webserver started at http://127.10.30.67:33961/ using document root <none> and password file <none>
I20260812 21:01:00.403400 32140 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:00.403532 32140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:00.403759 32140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:01:00.434520 32140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "6a0b47b650074f7190644660a7ff4224"
format_stamp: "Formatted at 2026-08-12 21:01:00 on dist-test-slave-h3ft"
server_key: "64549d350447717d428da039ad8eb5c1"
server_key_iv: "e3da947892ab5a305b5e486976ab4c04"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:00.435155 32140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "6a0b47b650074f7190644660a7ff4224"
format_stamp: "Formatted at 2026-08-12 21:01:00 on dist-test-slave-h3ft"
server_key: "64549d350447717d428da039ad8eb5c1"
server_key_iv: "e3da947892ab5a305b5e486976ab4c04"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:00.443297 32140 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.001s sys 0.001s
I20260812 21:01:00.490065 32171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:00.494011 32140 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.000s sys 0.000s
I20260812 21:01:00.494246 32140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "6a0b47b650074f7190644660a7ff4224"
format_stamp: "Formatted at 2026-08-12 21:01:00 on dist-test-slave-h3ft"
server_key: "64549d350447717d428da039ad8eb5c1"
server_key_iv: "e3da947892ab5a305b5e486976ab4c04"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:00.494406 32140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:00.529230 32140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:00.532799 32140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:00.532996 32140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:00.533341 32140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:00.533798 32140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:00.533849 32140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:00.533887 32140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:00.533908 32140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:00.544783 32140 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:42483
I20260812 21:01:00.545393 32140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:01:00.547468 32382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:42483 every 8 connection(s)
I20260812 21:01:00.547830 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 32140
I20260812 21:01:00.547955 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:01:00.548223 10361 external_mini_cluster.cc:1428] Setting key 4e7eb71f2e6d5b5768a78a1387a49feb
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:00.563334 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:00.550380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:39923 (local address 127.10.30.126:45737)
0812 21:01:00.550437 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:00.550440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:00.550669 (+ 229us) server_negotiation.cc:407] Connection header received
0812 21:01:00.551722 (+ 1053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:00.551723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:00.551739 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:00.551778 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:00.552863 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:00.553673 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:00.555277 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:00.555583 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:00.555639 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:00.559083 (+ 3444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:00.559086 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:00.559086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:00.559097 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:00.561382 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:00.562012 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:00.562013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:00.562014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:00.562092 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:00.562427 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:00.562428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:00.562428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:00.562611 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:00.562688 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:00.563100 (+ 412us) server_negotiation.cc:299] Negotiation successful
0812 21:01:00.563211 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 21:01:00.563552 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:00.550124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45737 (local address 127.10.30.67:39923)
0812 21:01:00.550510 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:00.550565 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:00.551527 (+ 962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:00.552016 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:00.552021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:00.552376 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:00.552726 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:00.552733 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:00.553819 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:00.553820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:00.555155 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:00.555159 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:00.555780 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:00.555781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:00.555939 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:00.556772 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:00.556786 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:00.558895 (+ 2109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:00.561508 (+ 2613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:00.561517 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:00.561521 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:00.561907 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:00.562168 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:00.562169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:00.562169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:00.562331 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:00.562682 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:00.562689 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:00.562895 (+ 206us) client_negotiation.cc:769] Sending connection context
0812 21:01:00.563048 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 21:01:00.563248 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":152,"threads_started":1}
I20260812 21:01:00.564308 32384 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45737
I20260812 21:01:00.564455 32384 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:00.564708 32384 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:01:00.565200 31549 ts_manager.cc:194] Registered new tserver with Master: 6a0b47b650074f7190644660a7ff4224 (127.10.30.67:42483)
I20260812 21:01:00.565764 31549 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:39923
I20260812 21:01:00.572695 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:01:00.573730 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 31688
I20260812 21:01:00.597800 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 31911
I20260812 21:01:00.616410 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 32140
I20260812 21:01:00.683691 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 31498
I20260812 21:01:00.718111 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:45737
--webserver_interface=127.10.30.126
--webserver_port=37085
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:45737
--ranger_config_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:47469/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.30.84:47469/kms with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:00.818049 32389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:00.818305 32389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:00.818328 32389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:00.819594 32389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:00.819643 32389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:00.819658 32389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:00.819671 32389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:00.819684 32389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:00.821856 32389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.30.84:47469/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:45737
--ranger_config_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:45737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=37085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:00.822170 32389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:00.822487 32389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:00.828368 32397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:00.828626 32389 server_base.cc:1034] running on GCE node
W20260812 21:01:00.828362 32399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:00.828413 32405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:00.829121 32389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:00.829483 32389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:00.830667 32389 hybrid_clock.cc:648] HybridClock initialized: now 1786568460830654 us; error 36 us; skew 500 ppm
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:00.833941 32389 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:01:00.834540 32389 webserver.cc:460] Webserver started at http://127.10.30.126:37085/ using document root <none> and password file <none>
I20260812 21:01:00.834849 32389 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:00.834934 32389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 21:01:00 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:01:00.893610 32389 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:01:00.894677 32417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:00.894892 32389 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:00.895053 32389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94"
format_stamp: "Formatted at 2026-08-12 21:00:58 on dist-test-slave-h3ft"
server_key: "99f66c36994f9ae184f38b6760219026"
server_key_iv: "f9619f78920421cf69fd00eefbb20010"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:00.895651 32389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:00.908310 32389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:00.910872 32389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:00.911131 32389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:00.916890 32389 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:45737
I20260812 21:01:00.916931 32513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:45737 every 8 connection(s)
I20260812 21:01:00.917500 32389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:01:00.919241 32516 sys_catalog.cc:263] Verifying existing consensus state
I20260812 21:01:00.920017 32516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Bootstrap starting.
I20260812 21:01:00.921203 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 32389
I20260812 21:01:00.921591 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:47469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:38341
--local_ip_for_outbound_sockets=127.10.30.65
--tserver_master_addrs=127.10.30.126:45737
--webserver_port=41915
--webserver_interface=127.10.30.65
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.30.84:47469/kms with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:00.930648 32516 log.cc:824] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:00.933017 32516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:01:00.933410 32516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Bootstrap complete.
I20260812 21:01:00.936457 32516 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } }
I20260812 21:01:00.936779 32516 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41b7f74bb5474fdf831b6cf1fcf1ad94, State: Initialized, Role: FOLLOWER
I20260812 21:01:00.937037 32516 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } }
I20260812 21:01:00.937146 32516 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:01:00.937207 32516 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:01:00.937263 32516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 1 FOLLOWER]: Advancing to term 2
I20260812 21:01:00.938551 32516 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } }
I20260812 21:01:00.938704 32516 leader_election.cc:302] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41b7f74bb5474fdf831b6cf1fcf1ad94; no voters:
I20260812 21:01:00.938978 32516 leader_election.cc:288] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 21:01:00.939133 32523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 21:01:00.939332 32523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [term 2 LEADER]: Becoming Leader. State: Replica: 41b7f74bb5474fdf831b6cf1fcf1ad94, State: Running, Role: LEADER
I20260812 21:01:00.939424 32516 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:00.939457 32523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } }
I20260812 21:01:00.939787 32524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } } }
I20260812 21:01:00.939788 32523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41b7f74bb5474fdf831b6cf1fcf1ad94. Latest consensus state: current_term: 2 leader_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b7f74bb5474fdf831b6cf1fcf1ad94" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 45737 } } }
I20260812 21:01:00.940007 32524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:00.940021 32523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:00.940929 32539 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:01:00.941416 32516 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 21:01:00.941661 32539 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:01:00.941825 32539 catalog_manager.cc:1259] Loaded cluster ID: 365e29be9af143c08ddbd390c3ea298a
I20260812 21:01:00.941869 32539 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:01:00.947095 32539 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:01:00.947918 32539 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Loaded TSK: 0
I20260812 21:01:00.948271 32539 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 21:01:01.032861 32521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:01.033125 32521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:01.033167 32521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:01.034463 32521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:01.034533 32521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:01.034581 32521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:01:01.036329 32521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.30.84:47469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:38341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=41915
--tserver_master_addrs=127.10.30.126:45737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:01.036646 32521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:01.036932 32521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:01.045112 32585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:01.045040 32579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:01.045991 32577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:01.047209 32521 server_base.cc:1034] running on GCE node
I20260812 21:01:01.047498 32521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:01.047855 32521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:01.049064 32521 hybrid_clock.cc:648] HybridClock initialized: now 1786568461048971 us; error 110 us; skew 500 ppm
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:01.052665 32521 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:01:01.053380 32521 webserver.cc:460] Webserver started at http://127.10.30.65:41915/ using document root <none> and password file <none>
I20260812 21:01:01.053731 32521 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:01.053845 32521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:01:01.080925 32521 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.001s sys 0.000s
I20260812 21:01:01.082404 32607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.082686 32521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:01.082792 32521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "18992c98fd71432b9980107ee6bbc020"
format_stamp: "Formatted at 2026-08-12 21:00:59 on dist-test-slave-h3ft"
server_key: "b5bfb09bfba9a3cbd2cbf2618a26721c"
server_key_iv: "4bcdc7c07f2ed44e40764024b2bb632f"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:01.084407 32521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:01.127915 32521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:01.130647 32521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:01.130859 32521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:01.131237 32521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:01.131707 32521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:01.131764 32521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.131810 32521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:01.131836 32521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.140930 32521 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:38341
I20260812 21:01:01.141577 32521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:01:01.142953 331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:38341 every 8 connection(s)
I20260812 21:01:01.150893 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 32521
I20260812 21:01:01.151350 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:47469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:43787
--local_ip_for_outbound_sockets=127.10.30.66
--tserver_master_addrs=127.10.30.126:45737
--webserver_port=44981
--webserver_interface=127.10.30.66
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.30.84:47469/kms with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:01.159988 334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:01.143459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:47067 (local address 127.10.30.126:45737)
0812 21:01:01.143721 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:01.143733 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:01.144256 (+ 523us) server_negotiation.cc:407] Connection header received
0812 21:01:01.145049 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:01.145055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:01.145105 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:01.145264 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:01.145990 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.147389 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.148488 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.148942 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.149081 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:01.154475 (+ 5394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:01.154483 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:01.154484 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:01.154505 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:01.157181 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:01.157746 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:01.157751 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:01.157752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:01.157880 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:01.158434 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:01.158435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:01.158435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:01.158819 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:01.158928 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:01.159429 (+ 501us) server_negotiation.cc:299] Negotiation successful
0812 21:01:01.159662 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":133,"threads_started":1}
I20260812 21:01:01.159988 339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:01.143872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45737 (local address 127.10.30.65:47067)
0812 21:01:01.144056 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:01.144103 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:01.144765 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:01.145307 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:01.145313 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:01.145583 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:01.145850 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:01.145857 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.147519 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.147520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:01.148372 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:01.148374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.149078 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.149080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:01.149221 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:01.149882 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:01.149893 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:01.154243 (+ 4350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:01.157303 (+ 3060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:01.157318 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:01.157321 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:01.157637 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:01.157960 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:01.157962 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:01.157963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:01.158318 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:01.158921 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:01.158934 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:01.159221 (+ 287us) client_negotiation.cc:769] Sending connection context
0812 21:01:01.159355 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 21:01:01.159663 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":105,"threads_started":1}
I20260812 21:01:01.161792 332 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45737
I20260812 21:01:01.161950 332 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.162252 332 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
W20260812 21:01:01.163424 332 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:45737 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 21:01:01.163519 332 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.163609 332 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:01:01.163988 332 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.164090 332 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
W20260812 21:01:01.164430 332 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 21:01:01.296765 340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:01.297096 340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:01.297152 340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:01.299548 340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:01.299659 340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:01.299721 340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:01:01.302316 340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.30.84:47469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:43787
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=44981
--tserver_master_addrs=127.10.30.126:45737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:01.302718 340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:01.303153 340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:01.312068 351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:01.312454 357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:01.312772 347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:01.313241 340 server_base.cc:1034] running on GCE node
I20260812 21:01:01.313676 340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:01.314117 340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:01.315320 340 hybrid_clock.cc:648] HybridClock initialized: now 1786568461315291 us; error 46 us; skew 500 ppm
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:01.319590 340 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:01:01.320489 340 webserver.cc:460] Webserver started at http://127.10.30.66:44981/ using document root <none> and password file <none>
I20260812 21:01:01.320940 340 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:01.321118 340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:01:01.351966 340 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 21:01:01.353637 375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.353878 340 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:01.353991 340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "23da957163de4ad49af253affb2ccda0"
format_stamp: "Formatted at 2026-08-12 21:01:00 on dist-test-slave-h3ft"
server_key: "2c9bd96e0d1ee74b672125a1d95a19f4"
server_key_iv: "e259bb8ec453100e7e4c9f21ea379aee"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:01.354627 340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:01.378283 340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:01.381016 340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:01.381230 340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:01.381587 340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:01.382014 340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:01.382072 340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.382138 340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:01.382164 340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.391295 340 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:43787
I20260812 21:01:01.391391 559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:43787 every 8 connection(s)
I20260812 21:01:01.391840 340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:01:01.393584 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 340
I20260812 21:01:01.393944 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.30.84:47469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:42483
--local_ip_for_outbound_sockets=127.10.30.67
--tserver_master_addrs=127.10.30.126:45737
--webserver_port=33961
--webserver_interface=127.10.30.67
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.30.84:47469/kms with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:01.407476 334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:01.392951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:50127 (local address 127.10.30.126:45737)
0812 21:01:01.393121 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:01.393124 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:01.393302 (+ 178us) server_negotiation.cc:407] Connection header received
0812 21:01:01.394198 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:01.394201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:01.394219 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:01.394259 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:01.395938 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.396836 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.399656 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.399986 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.400057 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:01.403538 (+ 3481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:01.403541 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:01.403542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:01.403554 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:01.405610 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:01.406190 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:01.406192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:01.406193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:01.406275 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:01.406594 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:01.406595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:01.406595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:01.406747 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:01.406827 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:01.407236 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 21:01:01.407359 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260812 21:01:01.408041 564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:01.392882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45737 (local address 127.10.30.66:50127)
0812 21:01:01.393121 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:01.393183 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:01.394024 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:01.394545 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:01.394552 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:01.394853 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:01.395804 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:01.395813 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.396956 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.396957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:01.399479 (+ 2522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:01.399485 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.400215 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.400216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:01.400395 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:01.401271 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:01.401284 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:01.403379 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:01.405746 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:01.405756 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:01.405759 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:01.406076 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:01.406356 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:01.406357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:01.406358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:01.406513 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:01.406815 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:01.406823 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:01.407069 (+ 246us) client_negotiation.cc:769] Sending connection context
0812 21:01:01.407200 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 21:01:01.407410 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":114,"threads_started":1}
I20260812 21:01:01.408646 561 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45737
I20260812 21:01:01.408792 561 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.409078 561 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
W20260812 21:01:01.409922 561 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:45737 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 21:01:01.410030 561 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.410128 561 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:01:01.410470 561 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.410567 561 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
W20260812 21:01:01.410955 561 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 21:01:01.547186 567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:01.547587 567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:01.547646 567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:01.549930 567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:01.550021 567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:01.550077 567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:01:01.553102 567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.30.84:47469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:42483
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=33961
--tserver_master_addrs=127.10.30.126:45737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:01.553511 567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:01.553917 567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:01.561733 586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:01.561748 580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:01.562693 582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:01.564167 567 server_base.cc:1034] running on GCE node
I20260812 21:01:01.564455 567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:01.564806 567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:01.565997 567 hybrid_clock.cc:648] HybridClock initialized: now 1786568461565969 us; error 42 us; skew 500 ppm
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:01.570791 567 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:01:01.571769 567 webserver.cc:460] Webserver started at http://127.10.30.67:33961/ using document root <none> and password file <none>
I20260812 21:01:01.572129 567 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:01.572230 567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
I20260812 21:01:01.603227 567 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 21:01:01.606220 602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.606513 567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260812 21:01:01.606649 567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "6a0b47b650074f7190644660a7ff4224"
format_stamp: "Formatted at 2026-08-12 21:01:00 on dist-test-slave-h3ft"
server_key: "64549d350447717d428da039ad8eb5c1"
server_key_iv: "e3da947892ab5a305b5e486976ab4c04"
server_key_version: "kuduclusterkey@0"
I20260812 21:01:01.607383 567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:01.629083 567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:01.631910 567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:01.632140 567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:01.632457 567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:01.632993 567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:01.633052 567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.633091 567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:01.633112 567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:01.642380 567 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:42483
I20260812 21:01:01.642575 819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:42483 every 8 connection(s)
I20260812 21:01:01.643043 567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:01:01.647840 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 567
Aug 12 21:01:01 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:01.658213 334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:01.644714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:43049 (local address 127.10.30.126:45737)
0812 21:01:01.644781 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:01.644784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:01.645209 (+ 425us) server_negotiation.cc:407] Connection header received
0812 21:01:01.646050 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:01.646052 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:01.646072 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:01.646153 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:01.647218 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.648126 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.650087 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.650393 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.650486 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:01.653858 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:01.653860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:01.653861 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:01.653872 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:01.656016 (+ 2144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:01.656686 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:01.656688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:01.656688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:01.656777 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:01.657190 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:01.657191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:01.657192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:01.657365 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:01.657440 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:01.657948 (+ 508us) server_negotiation.cc:299] Negotiation successful
0812 21:01:01.658072 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 21:01:01.659116 822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:01.644324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:45737 (local address 127.10.30.67:43049)
0812 21:01:01.644999 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:01.645063 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:01.645883 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:01.646334 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:01.646341 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:01.646663 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:01.647079 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:01.647087 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.648516 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.648517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:01.649958 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:01.649962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.650535 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.650536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:01.650727 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:01.651577 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:01.651592 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:01.653699 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:01.656125 (+ 2426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:01.656139 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:01.656143 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:01.656549 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:01.656879 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:01.656881 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:01.656881 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:01.657091 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:01.657522 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:01.657531 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:01.657788 (+ 257us) client_negotiation.cc:769] Sending connection context
0812 21:01:01.657920 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 21:01:01.658452 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":123,"threads_started":1}
I20260812 21:01:01.659729 820 heartbeater.cc:347] Connected to a master server at 127.10.30.126:45737
I20260812 21:01:01.659855 820 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.660154 820 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
W20260812 21:01:01.661060 820 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:45737 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 21:01:01.661151 820 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.661237 820 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:01:01.661615 820 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:01.661720 820 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
W20260812 21:01:01.662027 820 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 21:01:01.664469 827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:01.648353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47048 (local address 127.10.30.126:45737)
0812 21:01:01.651539 (+ 3186us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:01.651541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:01.651731 (+ 190us) server_negotiation.cc:407] Connection header received
0812 21:01:01.651759 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:01.651760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:01.651775 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:01.651863 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:01.652803 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.654680 (+ 1877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.655751 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:01.655995 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:01.656074 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:01.657692 (+ 1618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:01.657694 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:01.657695 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:01.657703 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:01.659757 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:01.663329 (+ 3572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:01.663332 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:01.663333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:01.663435 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:01.663671 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:01.663672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:01.663672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:01.663867 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:01.664154 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:01.664220 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 21:01:01.664343 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3153,"thread_start_us":93,"threads_started":1}
I20260812 21:01:02.164654 332 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:02.164898 332 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:01:02.165524 32450 ts_manager.cc:194] Registered new tserver with Master: 18992c98fd71432b9980107ee6bbc020 (127.10.30.65:38341)
I20260812 21:01:02.166867 32450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:47067
Aug 12 21:01:02 dist-test-slave-h3ft krb5kdc[30731](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786568462, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:02.411203 561 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:02.411430 561 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:01:02.411830 32450 ts_manager.cc:194] Registered new tserver with Master: 23da957163de4ad49af253affb2ccda0 (127.10.30.66:43787)
I20260812 21:01:02.412487 32450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:50127
I20260812 21:01:02.662256 820 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:02.662506 820 heartbeater.cc:511] Master 127.10.30.126:45737 requested a full tablet report, sending...
I20260812 21:01:02.663125 32450 ts_manager.cc:194] Registered new tserver with Master: 6a0b47b650074f7190644660a7ff4224 (127.10.30.67:42483)
I20260812 21:01:02.663723 32450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:43049
I20260812 21:01:02.668787 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:01:02.679860 853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:02.670026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47058 (local address 127.10.30.126:45737)
0812 21:01:02.670364 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:02.670367 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:02.670586 (+ 219us) server_negotiation.cc:407] Connection header received
0812 21:01:02.670617 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:02.670618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:02.670634 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:02.670708 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:02.671658 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.672504 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.673610 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.673956 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.674042 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:02.675945 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:02.675947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:02.675947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:02.675956 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:02.678082 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:02.678557 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:02.678558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:02.678559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:02.678635 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:02.678834 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:02.678835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:02.678835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:02.679027 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:02.679140 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:02.679607 (+ 467us) server_negotiation.cc:299] Negotiation successful
0812 21:01:02.679712 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":94,"threads_started":1}
I20260812 21:01:02.682991 32450 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47058:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:01:02.686188 32450 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:01:02.701102 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:02.694753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42483 (local address 127.0.0.1:38104)
0812 21:01:02.696013 (+ 1260us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:02.696070 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:02.696204 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:02.696549 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:02.696553 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:02.696556 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:02.696654 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:02.696656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.698003 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.698004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:02.699569 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:02.699573 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.700717 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.700718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:02.700810 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:02.700826 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 21:01:02.700912 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 21:01:02.700982 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1222,"thread_start_us":133,"threads_started":1}
I20260812 21:01:02.701565 863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:02.694754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:43787 (local address 127.0.0.1:37088)
0812 21:01:02.696334 (+ 1580us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:02.696343 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:02.696427 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:02.696730 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:02.696731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:02.696733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:02.696783 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:02.696784 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.698533 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.698534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:02.699848 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:02.699851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.701310 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.701311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:02.701392 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:02.701398 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:01:02.701442 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 21:01:02.701486 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1563,"mutex_wait_us":2,"thread_start_us":137,"threads_started":1}
I20260812 21:01:02.701807 869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:02.695442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38104 (local address 127.10.30.67:42483)
0812 21:01:02.695627 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:02.695631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:02.696200 (+ 569us) server_negotiation.cc:407] Connection header received
0812 21:01:02.696298 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:02.696301 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:02.696322 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:02.696417 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:02.696743 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.697897 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.699677 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.700517 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.700598 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:02.700679 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:02.701579 (+ 900us) server_negotiation.cc:299] Negotiation successful
0812 21:01:02.701630 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
I20260812 21:01:02.701846 868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:02.695232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37088 (local address 127.10.30.66:43787)
0812 21:01:02.695400 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:02.695407 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:02.696399 (+ 992us) server_negotiation.cc:407] Connection header received
0812 21:01:02.696514 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:02.696517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:02.696546 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:02.696602 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:02.696857 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.698391 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.699964 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.701126 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.701178 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:02.701235 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:02.701698 (+ 463us) server_negotiation.cc:299] Negotiation successful
0812 21:01:02.701753 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260812 21:01:02.702666 450 tablet_service.cc:1467] Processing CreateTablet for tablet dd8c9db785df429c9aeee68f205e4d8c (DEFAULT_TABLE table=test-table [id=bd4e108157df4c75a7cbd3fa6bbf9ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:02.702667 687 tablet_service.cc:1467] Processing CreateTablet for tablet dd8c9db785df429c9aeee68f205e4d8c (DEFAULT_TABLE table=test-table [id=bd4e108157df4c75a7cbd3fa6bbf9ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:02.703228 450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8c9db785df429c9aeee68f205e4d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:02.703229 687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8c9db785df429c9aeee68f205e4d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:02.708685 872 tablet_bootstrap.cc:492] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Bootstrap starting.
I20260812 21:01:02.709656 872 tablet_bootstrap.cc:654] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:02.709991 871 tablet_bootstrap.cc:492] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Bootstrap starting.
I20260812 21:01:02.710561 872 log.cc:824] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:02.713339 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:02.695116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:38341 (local address 127.0.0.1:57758)
0812 21:01:02.701426 (+ 6310us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:02.701439 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:02.701491 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:02.708887 (+ 7396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:02.708889 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:02.708893 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:02.708982 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:02.708985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.710501 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.710503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:02.711780 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:02.711785 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.713039 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.713040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:02.713120 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:02.713127 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 21:01:02.713160 (+ 33us) client_negotiation.cc:240] Negotiation successful
0812 21:01:02.713231 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6295,"thread_start_us":92,"threads_started":1}
I20260812 21:01:02.713881 870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:02.695739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57758 (local address 127.10.30.65:38341)
0812 21:01:02.708635 (+ 12896us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:02.708642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:02.708659 (+ 17us) server_negotiation.cc:407] Connection header received
0812 21:01:02.708713 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:02.708715 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:02.708738 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:02.709086 (+ 348us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:02.709212 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.710373 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.711913 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:02.712902 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:02.713593 (+ 691us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:02.713695 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:02.713730 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 21:01:02.713790 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12828,"thread_start_us":69,"threads_started":1}
I20260812 21:01:02.714601 871 tablet_bootstrap.cc:654] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:02.715022 871 log.cc:824] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:02.714901 32686 tablet_service.cc:1467] Processing CreateTablet for tablet dd8c9db785df429c9aeee68f205e4d8c (DEFAULT_TABLE table=test-table [id=bd4e108157df4c75a7cbd3fa6bbf9ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:02.715173 872 tablet_bootstrap.cc:492] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: No bootstrap required, opened a new log
I20260812 21:01:02.715265 872 ts_tablet_manager.cc:1397] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 21:01:02.715478 32686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8c9db785df429c9aeee68f205e4d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:02.718910 872 raft_consensus.cc:348] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:02.719185 872 raft_consensus.cc:374] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:02.719228 872 raft_consensus.cc:729] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a0b47b650074f7190644660a7ff4224, State: Initialized, Role: FOLLOWER
I20260812 21:01:02.719416 872 consensus_queue.cc:260] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:02.719882 872 ts_tablet_manager.cc:1428] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260812 21:01:02.720054 820 heartbeater.cc:503] Master 127.10.30.126:45737 was elected leader, sending a full tablet report...
I20260812 21:01:02.722091 879 tablet_bootstrap.cc:492] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020: Bootstrap starting.
I20260812 21:01:02.723410 879 tablet_bootstrap.cc:654] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:02.724007 879 log.cc:824] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:02.725673 871 tablet_bootstrap.cc:492] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: No bootstrap required, opened a new log
I20260812 21:01:02.725840 871 ts_tablet_manager.cc:1397] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260812 21:01:02.729626 871 raft_consensus.cc:348] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:02.730715 879 tablet_bootstrap.cc:492] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020: No bootstrap required, opened a new log
I20260812 21:01:02.730851 871 raft_consensus.cc:374] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:02.731047 871 raft_consensus.cc:729] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23da957163de4ad49af253affb2ccda0, State: Initialized, Role: FOLLOWER
I20260812 21:01:02.731954 871 consensus_queue.cc:260] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:02.732620 561 heartbeater.cc:503] Master 127.10.30.126:45737 was elected leader, sending a full tablet report...
I20260812 21:01:02.733768 879 ts_tablet_manager.cc:1397] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260812 21:01:02.735086 871 ts_tablet_manager.cc:1428] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260812 21:01:02.738788 879 raft_consensus.cc:348] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:02.739766 879 raft_consensus.cc:374] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:02.739903 879 raft_consensus.cc:729] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18992c98fd71432b9980107ee6bbc020, State: Initialized, Role: FOLLOWER
I20260812 21:01:02.740165 879 consensus_queue.cc:260] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:02.740715 879 ts_tablet_manager.cc:1428] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260812 21:01:02.740751 332 heartbeater.cc:503] Master 127.10.30.126:45737 was elected leader, sending a full tablet report...
Aug 12 21:01:02 dist-test-slave-h3ft krb5kdc[30731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568462, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for HTTP/127.10.30.84@KRBTEST.COM
W20260812 21:01:02.893589 562 tablet.cc:2369] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:01:02.894623 333 tablet.cc:2369] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:01:02.897329 821 tablet.cc:2369] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:01:03.014333 878 raft_consensus.cc:482] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:03.014586 878 raft_consensus.cc:504] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:03.015352 878 leader_election.cc:288] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23da957163de4ad49af253affb2ccda0 (127.10.30.66:43787), 18992c98fd71432b9980107ee6bbc020 (127.10.30.65:38341)
I20260812 21:01:03.020910 868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:03.016303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:49429 (local address 127.10.30.66:43787)
0812 21:01:03.016469 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:03.016472 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:03.016683 (+ 211us) server_negotiation.cc:407] Connection header received
0812 21:01:03.016806 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:03.016808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:03.016822 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:03.016855 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:03.017343 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.018218 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.019526 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.020287 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.020369 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:03.020383 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:03.020742 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 21:01:03.020801 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260812 21:01:03.021345 887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:03.015717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:43787 (local address 127.10.30.67:49429)
0812 21:01:03.016597 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:03.016611 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:03.016721 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:03.016952 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:03.016954 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:03.016955 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:03.017234 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:03.017238 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.018345 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.018346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:03.019401 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:03.019405 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.020512 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.020514 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:03.020632 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:03.020638 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:01:03.021049 (+ 411us) client_negotiation.cc:240] Negotiation successful
0812 21:01:03.021117 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":856,"thread_start_us":150,"threads_started":1}
I20260812 21:01:03.021840 484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd8c9db785df429c9aeee68f205e4d8c" candidate_uuid: "6a0b47b650074f7190644660a7ff4224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23da957163de4ad49af253affb2ccda0" is_pre_election: true
I20260812 21:01:03.022117 484 raft_consensus.cc:2454] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a0b47b650074f7190644660a7ff4224 in term 0.
I20260812 21:01:03.022439 606 leader_election.cc:302] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23da957163de4ad49af253affb2ccda0, 6a0b47b650074f7190644660a7ff4224; no voters:
I20260812 21:01:03.023409 878 raft_consensus.cc:2781] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:01:03.023540 878 raft_consensus.cc:482] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:01:03.023579 878 raft_consensus.cc:3037] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:03.024943 878 raft_consensus.cc:504] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:03.025166 878 leader_election.cc:288] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [CANDIDATE]: Term 1 election: Requested vote from peers 23da957163de4ad49af253affb2ccda0 (127.10.30.66:43787), 18992c98fd71432b9980107ee6bbc020 (127.10.30.65:38341)
I20260812 21:01:03.025499 484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd8c9db785df429c9aeee68f205e4d8c" candidate_uuid: "6a0b47b650074f7190644660a7ff4224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23da957163de4ad49af253affb2ccda0"
I20260812 21:01:03.025638 484 raft_consensus.cc:3037] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:03.025815 870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:03.016397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:48103 (local address 127.10.30.65:38341)
0812 21:01:03.016514 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:03.016516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:03.019767 (+ 3251us) server_negotiation.cc:407] Connection header received
0812 21:01:03.019887 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:03.019889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:03.019902 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:03.019933 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:03.020299 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.021042 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.022469 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.023297 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.023349 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:03.023360 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:03.025618 (+ 2258us) server_negotiation.cc:299] Negotiation successful
0812 21:01:03.025710 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 21:01:03.026134 885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:03.016027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:38341 (local address 127.10.30.67:48103)
0812 21:01:03.019672 (+ 3645us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:03.019695 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:03.019805 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:03.020049 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:03.020049 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:03.020051 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:03.020200 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:03.020201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.021204 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.021205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:03.022348 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:03.022352 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.025397 (+ 3045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.025398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:03.025504 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:03.025510 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:01:03.025972 (+ 462us) client_negotiation.cc:240] Negotiation successful
0812 21:01:03.026043 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3586,"thread_start_us":86,"threads_started":1}
I20260812 21:01:03.026785 32727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd8c9db785df429c9aeee68f205e4d8c" candidate_uuid: "6a0b47b650074f7190644660a7ff4224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18992c98fd71432b9980107ee6bbc020" is_pre_election: true
I20260812 21:01:03.027060 32727 raft_consensus.cc:2454] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a0b47b650074f7190644660a7ff4224 in term 0.
I20260812 21:01:03.027216 484 raft_consensus.cc:2454] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a0b47b650074f7190644660a7ff4224 in term 1.
I20260812 21:01:03.027330 32726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd8c9db785df429c9aeee68f205e4d8c" candidate_uuid: "6a0b47b650074f7190644660a7ff4224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18992c98fd71432b9980107ee6bbc020"
I20260812 21:01:03.027493 32726 raft_consensus.cc:3037] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:03.028939 32726 raft_consensus.cc:2454] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a0b47b650074f7190644660a7ff4224 in term 1.
I20260812 21:01:03.029109 606 leader_election.cc:302] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23da957163de4ad49af253affb2ccda0, 6a0b47b650074f7190644660a7ff4224; no voters:
I20260812 21:01:03.029594 878 raft_consensus.cc:2781] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:03.029866 878 raft_consensus.cc:686] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 1 LEADER]: Becoming Leader. State: Replica: 6a0b47b650074f7190644660a7ff4224, State: Running, Role: LEADER
I20260812 21:01:03.030053 878 consensus_queue.cc:237] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } }
I20260812 21:01:03.031523 32450 catalog_manager.cc:5495] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a0b47b650074f7190644660a7ff4224 (127.10.30.67). New cstate: current_term: 1 leader_uuid: "6a0b47b650074f7190644660a7ff4224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a0b47b650074f7190644660a7ff4224" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260812 21:01:03.065510 869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:03.062414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38120 (local address 127.10.30.67:42483)
0812 21:01:03.062483 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:03.062486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:03.062494 (+ 8us) server_negotiation.cc:407] Connection header received
0812 21:01:03.062549 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:03.062550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:03.062574 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:03.062661 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:01:03.062843 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.063473 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.064316 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:03.064549 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:03.064641 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:03.064830 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:01:03.065022 (+ 192us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:01:03.065105 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:03.065376 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 21:01:03.065407 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 21:01:03.069720 32726 raft_consensus.cc:1261] T dd8c9db785df429c9aeee68f205e4d8c P 18992c98fd71432b9980107ee6bbc020 [term 1 FOLLOWER]: Refusing update from remote peer 6a0b47b650074f7190644660a7ff4224: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:03.070322 888 consensus_queue.cc:1035] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18992c98fd71432b9980107ee6bbc020" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:03.073740 484 raft_consensus.cc:1261] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 1 FOLLOWER]: Refusing update from remote peer 6a0b47b650074f7190644660a7ff4224: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:03.074133 888 consensus_queue.cc:1035] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23da957163de4ad49af253affb2ccda0" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:03.081768 894 mvcc.cc:205] Tried to move back new op lower bound from 7317784424726511616 to 7317784424572583936. Current Snapshot: MvccSnapshot[applied={T|T < 7317784424726511616}]
I20260812 21:01:03.082156 898 mvcc.cc:205] Tried to move back new op lower bound from 7317784424726511616 to 7317784424572583936. Current Snapshot: MvccSnapshot[applied={T|T < 7317784424726511616}]
I20260812 21:01:03.088845 32450 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:03.089002 895 mvcc.cc:205] Tried to move back new op lower bound from 7317784424726511616 to 7317784424572583936. Current Snapshot: MvccSnapshot[applied={T|T < 7317784424726511616}]
I20260812 21:01:03.089071 32450 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:03.090627 32450 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 41b7f74bb5474fdf831b6cf1fcf1ad94: Sending DeleteTablet for 3 replicas of tablet dd8c9db785df429c9aeee68f205e4d8c
I20260812 21:01:03.091588 450 tablet_service.cc:1514] Processing DeleteTablet for tablet dd8c9db785df429c9aeee68f205e4d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:03 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:37088
I20260812 21:01:03.091992 32686 tablet_service.cc:1514] Processing DeleteTablet for tablet dd8c9db785df429c9aeee68f205e4d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:03 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:57758
I20260812 21:01:03.092677 687 tablet_service.cc:1514] Processing DeleteTablet for tablet dd8c9db785df429c9aeee68f205e4d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:03 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:38104
I20260812 21:01:03.093704 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 32521
I20260812 21:01:03.134315 917 tablet_replica.cc:330] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: stopping tablet replica
I20260812 21:01:03.134730 917 raft_consensus.cc:2229] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:01:03.135079 914 tablet_replica.cc:330] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: stopping tablet replica
I20260812 21:01:03.139256 917 raft_consensus.cc:2258] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:03.139711 914 raft_consensus.cc:2229] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:03.139932 914 raft_consensus.cc:2258] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:03.140959 914 ts_tablet_manager.cc:1905] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:03.141662 917 ts_tablet_manager.cc:1905] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:03.144150 917 ts_tablet_manager.cc:1918] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:03.144268 917 log.cc:1196] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/dd8c9db785df429c9aeee68f205e4d8c
I20260812 21:01:03.144619 917 ts_tablet_manager.cc:1939] T dd8c9db785df429c9aeee68f205e4d8c P 6a0b47b650074f7190644660a7ff4224: Deleting consensus metadata
I20260812 21:01:03.145304 32422 catalog_manager.cc:4841] TS 6a0b47b650074f7190644660a7ff4224 (127.10.30.67:42483): tablet dd8c9db785df429c9aeee68f205e4d8c (table test-table [id=bd4e108157df4c75a7cbd3fa6bbf9ace]) successfully deleted
I20260812 21:01:03.146416 914 ts_tablet_manager.cc:1918] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:03.146611 914 log.cc:1196] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/dd8c9db785df429c9aeee68f205e4d8c
I20260812 21:01:03.147080 914 ts_tablet_manager.cc:1939] T dd8c9db785df429c9aeee68f205e4d8c P 23da957163de4ad49af253affb2ccda0: Deleting consensus metadata
I20260812 21:01:03.159678 32420 catalog_manager.cc:4841] TS 23da957163de4ad49af253affb2ccda0 (127.10.30.66:43787): tablet dd8c9db785df429c9aeee68f205e4d8c (table test-table [id=bd4e108157df4c75a7cbd3fa6bbf9ace]) successfully deleted
W20260812 21:01:03.160226 32423 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:38341 (error 108)
I20260812 21:01:03.163211 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 340
I20260812 21:01:03.190765 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:03.190425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:38341 (local address 127.0.0.1:57764)
0812 21:01:03.190577 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:03.190686 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:38341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260812 21:01:03.191321 32423 catalog_manager.cc:4584] TS 18992c98fd71432b9980107ee6bbc020 (127.10.30.65:38341): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd8c9db785df429c9aeee68f205e4d8c: Network error: Client connection negotiation failed: client connection to 127.10.30.65:38341: connect: Connection refused (error 111)
I20260812 21:01:03.216445 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 567
I20260812 21:01:03.244115 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:03.243901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:38341 (local address 127.0.0.1:57768)
0812 21:01:03.243987 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:03.244040 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:38341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 21:01:03.245750 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:03.245618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:38341 (local address 127.0.0.1:57778)
0812 21:01:03.245666 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:03.245699 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:38341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 21:01:03.256340 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 32389
I20260812 21:01:03.274559 10361 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 21:01:03.631206 10361 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 21:01:03.631386 10361 mini_ranger.cc:66] Stopping Ranger...
I20260812 21:01:03.997969 10361 mini_ranger.cc:68] Stopped Ranger
2026-08-12 21:01:03.998 UTC [30780] LOG: received smart shutdown request
2026-08-12 21:01:04.005 UTC [30780] LOG: background worker "logical replication launcher" (PID 30794) exited with exit code 1
2026-08-12 21:01:04.005 UTC [30787] LOG: shutting down
2026-08-12 21:01:04.218 UTC [30780] LOG: database system is shut down
2026-08-12T21:01:04Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (61588 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:01:04 dist-test-slave-h3ft krb5kdc[933](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:01:04 dist-test-slave-h3ft krb5kdc[933](info): set up 2 sockets
Aug 12 21:01:04 dist-test-slave-h3ft krb5kdc[933](info): commencing operation
krb5kdc: starting...
W20260812 21:01:05.772881 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.397s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:01:05 dist-test-slave-h3ft krb5kdc[933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:01:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:01:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:01:05.927798 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41911
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:41911,127.10.30.125:44359,127.10.30.124:45311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:06.037122 959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:06.037501 959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:06.037559 959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:06.039264 959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:06.039381 959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:06.039414 959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:06.039443 959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:06.039484 959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:06.042021 959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:41911,127.10.30.125:44359,127.10.30.124:45311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:06.042506 959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:06.042843 959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:06.049674 965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:06.049674 967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:06.049783 959 server_base.cc:1034] running on GCE node
W20260812 21:01:06.049674 970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:06.051306 959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:06.051792 959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:06.053048 959 hybrid_clock.cc:648] HybridClock initialized: now 1786568466053030 us; error 51 us; skew 500 ppm
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:06.057248 959 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:01:06.057946 959 webserver.cc:460] Webserver started at http://127.10.30.126:45253/ using document root <none> and password file <none>
I20260812 21:01:06.058256 959 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:06.058339 959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:06.058522 959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:06.060019 959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "3212ac11e6264ae3bb1f2d1517330390"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "5a7783c083a4e4d75019e2e90399e592"
server_key_iv: "95763c9170d5695e64ca74b8f1687a15"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.060493 959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "3212ac11e6264ae3bb1f2d1517330390"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "5a7783c083a4e4d75019e2e90399e592"
server_key_iv: "95763c9170d5695e64ca74b8f1687a15"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.062299 959 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 21:01:06.063480 984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:06.063704 959 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:06.063838 959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "3212ac11e6264ae3bb1f2d1517330390"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "5a7783c083a4e4d75019e2e90399e592"
server_key_iv: "95763c9170d5695e64ca74b8f1687a15"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.063936 959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:06.087579 959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:06.091281 959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:06.091552 959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:06.097620 959 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:41911
I20260812 21:01:06.097733 1079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:41911 every 8 connection(s)
I20260812 21:01:06.098217 959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:01:06.099627 1083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:06.101727 1083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:01:06.107396 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 959
I20260812 21:01:06.107602 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:01:06.107930 10361 external_mini_cluster.cc:1428] Setting key 705da9eaa98ecefd7a33c8c329b3cfb8
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:06.115721 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.102758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41911 (local address 127.0.0.1:33274)
0812 21:01:06.103114 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.103171 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.103894 (+ 723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.104287 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.104290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.104689 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.104903 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.104908 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.106118 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.106119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.106894 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.106896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.107542 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.107543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.107620 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.108420 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.108432 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.110860 (+ 2428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.113708 (+ 2848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.113717 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.113720 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.113984 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.114304 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.114305 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.114305 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.114408 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.115096 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.115103 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.115179 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.115273 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.115471 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":161,"threads_started":1}
I20260812 21:01:06.115731 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.102803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.10.30.126:41911)
0812 21:01:06.103127 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.103140 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.103303 (+ 163us) server_negotiation.cc:407] Connection header received
0812 21:01:06.104117 (+ 814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.104120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.104157 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.104279 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.105023 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.105999 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.107046 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.107427 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.107586 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.111161 (+ 3575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.111173 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.111173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.111182 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.113585 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.114088 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.114093 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.114093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.114225 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.114486 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.114487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.114488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.114907 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.115049 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.115341 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.115526 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":249,"thread_start_us":143,"threads_started":1}
I20260812 21:01:06.116751 1083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:01:06.117242 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.117097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40024)
0812 21:01:06.117155 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.117216 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 21:01:06.117381 992 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
I20260812 21:01:06.117964 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.117847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40030)
0812 21:01:06.117900 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.117926 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 21:01:06.118070 1083 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:44359: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.10.30.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab.
Entry for principal kudu/127.10.30.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab.
I20260812 21:01:06.147743 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.125:44359
--webserver_interface=127.10.30.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab
--principal=kudu/127.10.30.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:41911,127.10.30.125:44359,127.10.30.124:45311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:06.167428 1083 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } attempt: 1
I20260812 21:01:06.168179 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.167973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40034)
0812 21:01:06.168065 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.168124 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 21:01:06.168593 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.168507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40038)
0812 21:01:06.168538 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.168571 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260812 21:01:06.168728 1083 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:44359: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
I20260812 21:01:06.236928 1083 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } attempt: 2
I20260812 21:01:06.237694 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.237468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40040)
0812 21:01:06.237589 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.237645 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 21:01:06.238292 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.238163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40044)
0812 21:01:06.238229 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.238263 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 21:01:06.238440 1083 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:44359: Network error: Client connection negotiation failed: client connection to 127.10.30.125:44359: connect: Connection refused (error 111)
W20260812 21:01:06.250180 1103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:06.250480 1103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:06.250510 1103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:06.252030 1103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:06.252108 1103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:06.252125 1103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:06.252138 1103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:06.252151 1103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:06.254211 1103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:41911,127.10.30.125:44359,127.10.30.124:45311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab
--principal=kudu/127.10.30.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.125:44359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.30.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:06.254592 1103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:06.254897 1103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:06.261075 1122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:06.261039 1116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:06.261013 1120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:06.261394 1103 server_base.cc:1034] running on GCE node
I20260812 21:01:06.261739 1103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:06.262133 1103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:06.263299 1103 hybrid_clock.cc:648] HybridClock initialized: now 1786568466263270 us; error 43 us; skew 500 ppm
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:06.266690 1103 init.cc:377] Logged in from keytab as kudu/127.10.30.125@KRBTEST.COM (short username kudu)
I20260812 21:01:06.267640 1103 webserver.cc:460] Webserver started at http://127.10.30.125:34111/ using document root <none> and password file <none>
I20260812 21:01:06.267948 1103 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:06.268005 1103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:06.268177 1103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:06.269565 1103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/data/instance:
uuid: "c4367768bd7643b39d37f1500aef5606"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "381eba5e1a4f70f9e08543ee3effdd5b"
server_key_iv: "d19cd7cf623246b41199a511fc8e23db"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.270061 1103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/wal/instance:
uuid: "c4367768bd7643b39d37f1500aef5606"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "381eba5e1a4f70f9e08543ee3effdd5b"
server_key_iv: "d19cd7cf623246b41199a511fc8e23db"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.271924 1103 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:01:06.273073 1131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:06.273334 1103 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:06.273469 1103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/wal
uuid: "c4367768bd7643b39d37f1500aef5606"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "381eba5e1a4f70f9e08543ee3effdd5b"
server_key_iv: "d19cd7cf623246b41199a511fc8e23db"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.273554 1103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:06.292209 1103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:06.295215 1103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:06.295459 1103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:06.300930 1103 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.125:44359
I20260812 21:01:06.301014 1228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.125:44359 every 8 connection(s)
I20260812 21:01:06.301467 1103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
I20260812 21:01:06.302587 1230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:06.304659 1230 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:01:06.306958 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 1103
I20260812 21:01:06.307251 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-1/wal/instance
I20260812 21:01:06.307513 10361 external_mini_cluster.cc:1428] Setting key 1234907430655ad3caaf69c414d5f771
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:06.316195 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.305619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33278 (local address 127.10.30.126:41911)
0812 21:01:06.305720 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.305722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.306010 (+ 288us) server_negotiation.cc:407] Connection header received
0812 21:01:06.306661 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.306663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.306685 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.306743 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.307777 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.308337 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.309473 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.309716 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.309816 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.312763 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.312765 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.312766 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.312776 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.314429 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.314967 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.314968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.314969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.315093 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.315382 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.315383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.315384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.315543 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.315626 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.315956 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.316075 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 21:01:06.316447 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.305564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41911 (local address 127.0.0.1:33278)
0812 21:01:06.305815 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.305861 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.306520 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.306836 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.306840 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.307331 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.307665 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.307671 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.308457 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.308458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.309359 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.309362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.309836 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.309837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.309998 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.310712 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.310722 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.312616 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.314556 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.314568 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.314571 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.314850 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.315168 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.315169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.315170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.315302 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.315614 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.315623 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.315800 (+ 177us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.315921 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.316149 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":118,"threads_started":1}
I20260812 21:01:06.317217 1230 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.30.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.124@KRBTEST.COM" created.
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
I20260812 21:01:06.326208 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.317565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40046)
0812 21:01:06.317619 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.317630 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.317675 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.318033 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.318034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.318201 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.318273 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.318275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.319399 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.319401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.319933 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.319934 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.320453 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.320454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.320539 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.321127 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.321133 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.322591 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.324996 (+ 2405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.324997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.324998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.325184 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.325437 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.325438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.325438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.325499 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.325899 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.325900 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.325955 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.326022 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.326118 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 21:01:06.326522 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.317682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40046 (local address 127.10.30.125:44359)
0812 21:01:06.317873 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.317877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.317895 (+ 18us) server_negotiation.cc:407] Connection header received
0812 21:01:06.317912 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.317914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.317926 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.318031 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.318359 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.319303 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.320040 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.320373 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.320459 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.322693 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.322706 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.322707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.322715 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.324866 (+ 2151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.325279 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.325283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.325284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.325361 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.325565 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.325566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.325566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.325812 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.325909 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.326085 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.326220 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":160,"thread_start_us":123,"threads_started":1}
I20260812 21:01:06.327448 1230 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:01:06.327924 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.327779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:44940)
0812 21:01:06.327837 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.327894 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 21:01:06.328126 1132 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
I20260812 21:01:06.328619 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.328505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:44954)
0812 21:01:06.328559 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.328587 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 21:01:06.328725 1230 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:45311: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
I20260812 21:01:06.329653 1083 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } attempt: 3
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
I20260812 21:01:06.339984 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.330176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40056 (local address 127.10.30.125:44359)
0812 21:01:06.330228 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.330230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.330244 (+ 14us) server_negotiation.cc:407] Connection header received
0812 21:01:06.330320 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.330321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.330334 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.330408 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.330792 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.331467 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.332220 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.332458 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.332547 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.336681 (+ 4134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.336684 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.336685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.336699 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.338516 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.338936 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.338938 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.338939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.339082 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.339300 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.339301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.339302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.339475 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.339595 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.339768 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.339868 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 21:01:06.339987 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.330129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40056)
0812 21:01:06.330181 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.330195 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.330252 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.330415 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.330415 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.330616 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.330702 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.330704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.331568 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.331572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.332129 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.332131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.332544 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.332545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.332652 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.333217 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.333222 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.336539 (+ 3317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.338623 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.338625 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.338626 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.338831 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.339159 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.339160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.339161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.339234 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.339585 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.339587 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.339648 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.339739 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.339865 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 21:01:06.340811 1083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:01:06.341353 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.341180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:44968)
0812 21:01:06.341264 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.341308 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 21:01:06.342087 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.341854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:44974)
0812 21:01:06.341961 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.342056 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260812 21:01:06.342216 1083 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:45311: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab.
Entry for principal kudu/127.10.30.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab.
I20260812 21:01:06.343538 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.124:45311
--webserver_interface=127.10.30.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab
--principal=kudu/127.10.30.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:41911,127.10.30.125:44359,127.10.30.124:45311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:06.373412 1083 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } attempt: 1
I20260812 21:01:06.374177 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.373981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:44990)
0812 21:01:06.374080 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.374130 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 21:01:06.374636 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.374527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:44996)
0812 21:01:06.374578 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.374613 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 21:01:06.374737 1083 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:45311: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
I20260812 21:01:06.377980 1230 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } attempt: 1
I20260812 21:01:06.378479 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.378316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45000)
0812 21:01:06.378412 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.378447 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 21:01:06.378865 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.378761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45002)
0812 21:01:06.378807 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.378833 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 21:01:06.378958 1230 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:45311: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
W20260812 21:01:06.443737 1249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:06.444094 1249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:06.444141 1249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:06.445540 1249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:06.445631 1249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:06.445655 1249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:06.445676 1249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:06.445704 1249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:06.447129 1230 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } attempt: 2
I20260812 21:01:06.447721 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.447551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45006)
0812 21:01:06.447631 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.447679 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 21:01:06.447722 1249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:41911,127.10.30.125:44359,127.10.30.124:45311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab
--principal=kudu/127.10.30.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.124:45311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.30.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:06.448113 1249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:06.448275 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.448126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45014)
0812 21:01:06.448202 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.448241 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 21:01:06.448392 1230 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:45311: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
I20260812 21:01:06.448496 1249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 21:01:06.449958 1083 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } attempt: 2
I20260812 21:01:06.450513 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.450351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45016)
0812 21:01:06.450436 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.450478 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 21:01:06.450963 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.450862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45024)
0812 21:01:06.450915 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.450942 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 21:01:06.451159 1083 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:45311: Network error: Client connection negotiation failed: client connection to 127.10.30.124:45311: connect: Connection refused (error 111)
W20260812 21:01:06.454967 1266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:06.454967 1259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:06.454988 1262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:06.455387 1249 server_base.cc:1034] running on GCE node
I20260812 21:01:06.455752 1249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:06.456166 1249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:06.457331 1249 hybrid_clock.cc:648] HybridClock initialized: now 1786568466457314 us; error 30 us; skew 500 ppm
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:06.460719 1249 init.cc:377] Logged in from keytab as kudu/127.10.30.124@KRBTEST.COM (short username kudu)
I20260812 21:01:06.461484 1249 webserver.cc:460] Webserver started at http://127.10.30.124:36635/ using document root <none> and password file <none>
I20260812 21:01:06.461768 1249 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:06.461851 1249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:06.462033 1249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:06.463430 1249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/data/instance:
uuid: "989ff92366504b6182deb23e7f444790"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "e3d4d0c370bce7b3d5d902fdbb7121ad"
server_key_iv: "ddc1ef1d35e90b87721098f8c731f346"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.463900 1249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/wal/instance:
uuid: "989ff92366504b6182deb23e7f444790"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "e3d4d0c370bce7b3d5d902fdbb7121ad"
server_key_iv: "ddc1ef1d35e90b87721098f8c731f346"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.465603 1249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 21:01:06.466667 1277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:06.466979 1249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:06.467149 1249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/wal
uuid: "989ff92366504b6182deb23e7f444790"
format_stamp: "Formatted at 2026-08-12 21:01:06 on dist-test-slave-h3ft"
server_key: "e3d4d0c370bce7b3d5d902fdbb7121ad"
server_key_iv: "ddc1ef1d35e90b87721098f8c731f346"
server_key_version: "encryptionkey@0"
I20260812 21:01:06.467247 1249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:06.494294 1249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:06.497575 1249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:06.497786 1249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:06.503594 1249 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.124:45311
I20260812 21:01:06.503695 1372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.124:45311 every 8 connection(s)
I20260812 21:01:06.504120 1249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
I20260812 21:01:06.505371 1373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:06.507455 1373 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:01:06.511948 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 1249
I20260812 21:01:06.512099 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786568275908695-10361-0/minicluster-data/master-2/wal/instance
I20260812 21:01:06.512356 10361 external_mini_cluster.cc:1428] Setting key c9fefae95a96cd99fff328d7915b0b87
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:01:06.520040 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.508489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33284 (local address 127.10.30.126:41911)
0812 21:01:06.508581 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.508583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.508790 (+ 207us) server_negotiation.cc:407] Connection header received
0812 21:01:06.509379 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.509380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.509395 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.509498 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.510552 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.511244 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.512664 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.512924 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.513021 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.516189 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.516196 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.516196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.516206 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.518231 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.518757 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.518759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.518759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.518835 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.519202 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.519203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.519204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.519350 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.519425 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.519799 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.519907 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 21:01:06.520280 1376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.508372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41911 (local address 127.0.0.1:33284)
0812 21:01:06.508603 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.508660 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.509239 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.509656 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.509664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.510085 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.510385 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.510391 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.511368 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.511369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.512530 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.512534 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.513111 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.513113 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.513329 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.514155 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.514168 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.516079 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.518337 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.518348 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.518351 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.518658 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.518912 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.518913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.518913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.519122 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.519434 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.519444 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.519623 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.519744 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.519953 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":117,"threads_started":1}
I20260812 21:01:06.521328 1373 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:01:06.523790 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.512891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45028 (local address 127.10.30.124:45311)
0812 21:01:06.513159 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.513164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.513183 (+ 19us) server_negotiation.cc:407] Connection header received
0812 21:01:06.513205 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.513207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.513228 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.513303 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.514165 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.514925 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.515932 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.516296 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.516368 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.519550 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.519564 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.519565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.519578 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.522169 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.522660 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.522663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.522663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.522732 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.522988 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.522990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.522990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.523255 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.523493 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.523543 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.523637 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":135,"threads_started":1}
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:06.530167 1376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.521775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:44359 (local address 127.0.0.1:40070)
0812 21:01:06.521838 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.521852 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.521905 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.522075 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.522076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.522273 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.522332 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.522334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.523308 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.523309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.524095 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.524098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.524590 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.524591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.524664 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.525313 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.525320 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.526748 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.528883 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.528885 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.528885 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.529140 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.529355 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.529356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.529356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.529438 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.529818 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.529819 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.529889 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.529972 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.530078 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 21:01:06.530252 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.521858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40070 (local address 127.10.30.125:44359)
0812 21:01:06.521935 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.521937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.521949 (+ 12us) server_negotiation.cc:407] Connection header received
0812 21:01:06.521987 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.521988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.521999 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.522057 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.522424 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.523230 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.524197 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.524513 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.524599 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.526858 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.526860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.526861 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.526873 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.528771 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.529223 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.529224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.529224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.529282 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.529534 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.529535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.529536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.529712 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.529792 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.530027 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.530123 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 21:01:06.530930 1373 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:01:06.534408 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.525028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33292 (local address 127.10.30.126:41911)
0812 21:01:06.525091 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.525094 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.525171 (+ 77us) server_negotiation.cc:407] Connection header received
0812 21:01:06.525258 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.525259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.525274 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.525335 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.525903 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.526408 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.527394 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.527613 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.527701 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.530837 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.530839 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.530840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.530850 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.532962 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.533381 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.533382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.533383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.533462 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.533674 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.533675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.533676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.533845 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.534099 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.534176 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.534281 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:01:06.539561 1230 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } attempt: 3
I20260812 21:01:06.539896 1376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.531323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45036)
0812 21:01:06.531421 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.531434 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.531485 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.531603 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.531604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.531764 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.531816 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.531818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.532658 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.532659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.533350 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.533353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.533729 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.533730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.533784 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.534237 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.534242 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.536012 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.538102 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.538103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.538103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.538277 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.539167 (+ 890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.539168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.539168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.539232 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.539507 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.539508 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.539552 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.539628 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.539755 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 21:01:06.540038 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.531376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45036 (local address 127.10.30.124:45311)
0812 21:01:06.531425 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.531427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.531469 (+ 42us) server_negotiation.cc:407] Connection header received
0812 21:01:06.531539 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.531539 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.531551 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.531596 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.531912 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.532548 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.533446 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.533669 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.533727 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.536119 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.536122 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.536122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.536130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.538009 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.538977 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.538978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.538978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.539090 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.539306 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.539307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.539308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.539438 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.539537 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.539670 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.539832 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":22}
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
I20260812 21:01:06.542846 1373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790: Bootstrap starting.
I20260812 21:01:06.544126 1373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:06.544456 1373 log.cc:824] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790: Log is configured to *not* fsync() on all Append() calls
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:01:06.545584 1373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790: No bootstrap required, opened a new log
I20260812 21:01:06.545872 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.536894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40078 (local address 127.10.30.125:44359)
0812 21:01:06.536970 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.536972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.536981 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:01:06.537009 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.537011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.537021 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.537096 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.537763 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.538267 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.538980 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.539263 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.539347 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.542201 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.542202 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.542203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.542211 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.544375 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.544846 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.544847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.544848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.544919 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.545153 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.545155 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.545155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.545292 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.545558 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.545601 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.545686 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 21:01:06.547660 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:01:06.548521 1373 raft_consensus.cc:348] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.548739 1373 raft_consensus.cc:374] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:06.548784 1373 raft_consensus.cc:729] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989ff92366504b6182deb23e7f444790, State: Initialized, Role: FOLLOWER
I20260812 21:01:06.548991 1373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.549072 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.539874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45042)
0812 21:01:06.539937 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.539952 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.539998 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.540283 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.540284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.540496 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.540549 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.540551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.541410 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.541411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.542223 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.542227 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.542721 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.542722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.542792 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.543540 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.543546 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.545409 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.547733 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.547734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.547735 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.547984 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.548284 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.548285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.548285 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.548355 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.548719 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.548720 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.548781 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.548834 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.548963 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 21:01:06.549566 1373 sys_catalog.cc:564] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:06.549795 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.540114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45042 (local address 127.10.30.124:45311)
0812 21:01:06.540149 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.540151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.540158 (+ 7us) server_negotiation.cc:407] Connection header received
0812 21:01:06.540180 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.540181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.540192 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.540625 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.540657 (+ 32us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.541287 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.542328 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.542620 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.542690 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.545520 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.545522 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.545522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.545530 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.547613 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.548134 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.548135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.548135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.548206 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.548449 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.548450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.548450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.548633 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.549549 (+ 916us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.549599 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.549700 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19,"thread_start_us":142,"threads_started":1}
W20260812 21:01:06.552278 1421 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:01:06.552361 1421 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:01:06.552702 1230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606: Bootstrap starting.
I20260812 21:01:06.553721 1230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:06.554155 1230 log.cc:824] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:06.554466 1083 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } attempt: 3
I20260812 21:01:06.559242 1391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.559424 1391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:01:06.556226 1249 master_runner.cc:186] Error getting master registration for 127.10.30.126:41911: OK, instance_id { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" instance_seqno: 1786568466095812 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
Aug 12 21:01:06 dist-test-slave-h3ft krb5kdc[933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568466, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:01:06.560240 1249 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 21:01:06.562907 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.550711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33302 (local address 127.10.30.126:41911)
0812 21:01:06.550770 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.550773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.551650 (+ 877us) server_negotiation.cc:407] Connection header received
0812 21:01:06.551770 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.551772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.551788 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.551822 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.552851 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.553713 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.554849 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.555193 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.555239 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.557267 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.557269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.557269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.557279 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.561315 (+ 4036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.561798 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.561800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.561801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.561886 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.562135 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.562136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.562136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.562306 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.562406 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.562656 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.562756 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 21:01:06.562937 1230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606: No bootstrap required, opened a new log
I20260812 21:01:06.565091 1383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.550438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45054 (local address 127.10.30.124:45311)
0812 21:01:06.550490 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.550491 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.550910 (+ 419us) server_negotiation.cc:407] Connection header received
0812 21:01:06.551041 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.551043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.551055 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.551109 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.552999 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.553762 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.557101 (+ 3339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.557424 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.557474 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.560008 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.560011 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.560011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.560020 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.561854 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.563980 (+ 2126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.563981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.563982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.564090 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.564320 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.564321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.564321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.564477 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.564592 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.564819 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.564934 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 21:01:06.565564 1230 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.565762 1230 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:06.565811 1230 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4367768bd7643b39d37f1500aef5606, State: Initialized, Role: FOLLOWER
I20260812 21:01:06.566159 1230 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.566625 1230 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:06.566852 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.550368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40090 (local address 127.10.30.125:44359)
0812 21:01:06.550434 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.550437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.550869 (+ 432us) server_negotiation.cc:407] Connection header received
0812 21:01:06.550988 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.550989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.551051 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.551092 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.554003 (+ 2911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.554717 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.557893 (+ 3176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.558233 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.558287 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.562881 (+ 4594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.562883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.562884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.562894 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.565365 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.565792 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.565793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.565794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.565862 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.566076 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.566077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.566078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.566211 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.566270 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.566644 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.566741 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260812 21:01:06.569818 1443 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:01:06.570206 1443 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:01:06.570739 1427 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.570880 1427 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:01:06.571734 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.554801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:45311 (local address 127.0.0.1:45066)
0812 21:01:06.554915 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:06.554928 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:06.554989 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:06.555844 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:06.555845 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:06.556124 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:06.556177 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.556179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.557213 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.557214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.557949 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:06.557951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.558438 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.558439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:06.558496 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.558845 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:06.558850 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:06.560600 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:06.570075 (+ 9475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.570077 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.570078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.570356 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.570621 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:06.570622 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:06.570622 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:06.570712 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:06.571325 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:06.571326 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:06.571393 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 21:01:06.571478 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 21:01:06.571608 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 21:01:06.572201 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:06.555431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45066 (local address 127.10.30.124:45311)
0812 21:01:06.555692 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:06.555695 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:06.555706 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:01:06.555731 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:06.555731 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:06.555744 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:06.556256 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:06.556294 (+ 38us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.557102 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.558071 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:06.558347 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:06.558651 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:06.561434 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:06.561435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:06.561436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:06.561444 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:06.569931 (+ 8487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.570457 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.570458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.570459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.570530 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:06.570803 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:06.570804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:06.570805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:06.571239 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:06.571332 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:06.571540 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 21:01:06.571665 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":202,"threads_started":1}
I20260812 21:01:06.569836 1103 master_runner.cc:186] Error getting master registration for 127.10.30.126:41911: OK, instance_id { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" instance_seqno: 1786568466095812 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 21:01:06.573601 1103 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 21:01:06.574455 1083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: Bootstrap starting.
I20260812 21:01:06.575459 1083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:06.575838 1083 log.cc:824] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:06.576861 1083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: No bootstrap required, opened a new log
I20260812 21:01:06.579576 1083 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.579763 1083 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:06.579802 1083 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3212ac11e6264ae3bb1f2d1517330390, State: Initialized, Role: FOLLOWER
I20260812 21:01:06.579975 1083 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.580470 1083 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:06.580420 1447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.580991 1447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 21:01:06.582710 1463 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:01:06.582834 1463 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:01:06.585269 959 master_runner.cc:263] No leader master found from master 3212ac11e6264ae3bb1f2d1517330390
I20260812 21:01:06.585337 959 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 21:01:06.592657 997 tablet.cc:2369] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:01:06.608791 1391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:06.609032 1391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.609395 1391 leader_election.cc:288] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3212ac11e6264ae3bb1f2d1517330390 (127.10.30.126:41911), c4367768bd7643b39d37f1500aef5606 (127.10.30.125:44359)
I20260812 21:01:06.609956 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "989ff92366504b6182deb23e7f444790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3212ac11e6264ae3bb1f2d1517330390" is_pre_election: true
I20260812 21:01:06.610208 1033 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 989ff92366504b6182deb23e7f444790 in term 0.
I20260812 21:01:06.610685 1182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "989ff92366504b6182deb23e7f444790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4367768bd7643b39d37f1500aef5606" is_pre_election: true
I20260812 21:01:06.610909 1182 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 989ff92366504b6182deb23e7f444790 in term 0.
I20260812 21:01:06.611258 1284 leader_election.cc:302] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989ff92366504b6182deb23e7f444790, c4367768bd7643b39d37f1500aef5606; no voters:
I20260812 21:01:06.612599 1391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:01:06.612701 1391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:01:06.612730 1391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:06.614018 1391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.614205 1391 leader_election.cc:288] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [CANDIDATE]: Term 1 election: Requested vote from peers 3212ac11e6264ae3bb1f2d1517330390 (127.10.30.126:41911), c4367768bd7643b39d37f1500aef5606 (127.10.30.125:44359)
I20260812 21:01:06.614441 1033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "989ff92366504b6182deb23e7f444790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3212ac11e6264ae3bb1f2d1517330390"
I20260812 21:01:06.614557 1033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:06.615430 1182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "989ff92366504b6182deb23e7f444790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4367768bd7643b39d37f1500aef5606"
I20260812 21:01:06.615556 1182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:06.616750 1182 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989ff92366504b6182deb23e7f444790 in term 1.
I20260812 21:01:06.617023 1284 leader_election.cc:302] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989ff92366504b6182deb23e7f444790, c4367768bd7643b39d37f1500aef5606; no voters:
I20260812 21:01:06.618054 1033 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989ff92366504b6182deb23e7f444790 in term 1.
I20260812 21:01:06.618316 1391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:06.618579 1391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [term 1 LEADER]: Becoming Leader. State: Replica: 989ff92366504b6182deb23e7f444790, State: Running, Role: LEADER
I20260812 21:01:06.618723 1391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } }
I20260812 21:01:06.619323 1391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 989ff92366504b6182deb23e7f444790. Latest consensus state: current_term: 1 leader_uuid: "989ff92366504b6182deb23e7f444790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.619419 1391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:06.619882 1470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:01:06.620174 1470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:01:06.622726 1182 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [term 1 FOLLOWER]: Refusing update from remote peer 989ff92366504b6182deb23e7f444790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:06.623135 1391 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:06.624826 1427 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 989ff92366504b6182deb23e7f444790. Latest consensus state: current_term: 1 leader_uuid: "989ff92366504b6182deb23e7f444790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.624949 1427 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:01:06.625451 1033 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [term 1 FOLLOWER]: Refusing update from remote peer 989ff92366504b6182deb23e7f444790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:06.625761 1391 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:06.629033 1447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 989ff92366504b6182deb23e7f444790. Latest consensus state: current_term: 1 leader_uuid: "989ff92366504b6182deb23e7f444790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.629179 1447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:01:06.633311 1471 mvcc.cc:205] Tried to move back new op lower bound from 7317784439283531776 to 7317784439271206912. Current Snapshot: MvccSnapshot[applied={T|T < 7317784439283531776}]
I20260812 21:01:06.633661 1391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "989ff92366504b6182deb23e7f444790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.633764 1391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:06.634415 1427 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "989ff92366504b6182deb23e7f444790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.634539 1427 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:01:06.634775 1472 mvcc.cc:205] Tried to move back new op lower bound from 7317784439283531776 to 7317784439271206912. Current Snapshot: MvccSnapshot[applied={T|T < 7317784439283531776}]
I20260812 21:01:06.635341 1391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "989ff92366504b6182deb23e7f444790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.635442 1391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:06.636027 1447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "989ff92366504b6182deb23e7f444790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3212ac11e6264ae3bb1f2d1517330390" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41911 } } peers { permanent_uuid: "c4367768bd7643b39d37f1500aef5606" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 44359 } } peers { permanent_uuid: "989ff92366504b6182deb23e7f444790" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 45311 } } }
I20260812 21:01:06.636147 1447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:01:06.636385 1481 mvcc.cc:205] Tried to move back new op lower bound from 7317784439283531776 to 7317784439271206912. Current Snapshot: MvccSnapshot[applied={T|T < 7317784439283531776}]
I20260812 21:01:06.638186 1470 catalog_manager.cc:1347] Generated new cluster ID: 265cf8b435894a2bbd3d581c32ddf153
I20260812 21:01:06.638252 1470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:01:06.665484 1470 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:01:06.666442 1470 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:01:06.688817 1470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 989ff92366504b6182deb23e7f444790: Generated new TSK 0
I20260812 21:01:06.689172 1470 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:01:07.570935 1443 catalog_manager.cc:1259] Loaded cluster ID: 265cf8b435894a2bbd3d581c32ddf153
I20260812 21:01:07.571127 1443 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606: loading cluster ID for follower catalog manager: success
I20260812 21:01:07.572162 1443 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606: acquiring CA information for follower catalog manager: success
I20260812 21:01:07.572578 1443 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c4367768bd7643b39d37f1500aef5606: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 21:01:07.583652 1463 catalog_manager.cc:1259] Loaded cluster ID: 265cf8b435894a2bbd3d581c32ddf153
I20260812 21:01:07.583757 1463 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: loading cluster ID for follower catalog manager: success
I20260812 21:01:07.584801 1463 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: acquiring CA information for follower catalog manager: success
I20260812 21:01:07.585212 1463 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3212ac11e6264ae3bb1f2d1517330390: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 21:01:07.761830 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 959
I20260812 21:01:07.777755 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 1103
I20260812 21:01:07.796371 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 1249
2026-08-12T21:01:07Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3458 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:01:07 dist-test-slave-h3ft krb5kdc[1505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:01:07 dist-test-slave-h3ft krb5kdc[1505](info): set up 2 sockets
Aug 12 21:01:07 dist-test-slave-h3ft krb5kdc[1505](info): commencing operation
krb5kdc: starting...
W20260812 21:01:09.212987 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.379s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:01:09 dist-test-slave-h3ft krb5kdc[1505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:01:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:01:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:01:09.378878 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:46197
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:46197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:09.479306 1524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:09.479667 1524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:09.479715 1524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:09.481113 1524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:09.481201 1524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:09.481226 1524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:09.481247 1524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:09.481279 1524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:09.483047 1524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:46197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:46197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:09.483389 1524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:09.483685 1524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:09.489903 1529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:09.489895 1530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:09.490267 1524 server_base.cc:1034] running on GCE node
W20260812 21:01:09.489903 1532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:09.490628 1524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:09.491058 1524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:09.492257 1524 hybrid_clock.cc:648] HybridClock initialized: now 1786568469492240 us; error 46 us; skew 500 ppm
Aug 12 21:01:09 dist-test-slave-h3ft krb5kdc[1505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568469, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:09.500869 1524 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:01:09.501508 1524 webserver.cc:460] Webserver started at http://127.10.30.126:45511/ using document root <none> and password file <none>
I20260812 21:01:09.501809 1524 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:09.501865 1524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:09.502027 1524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:09.503535 1524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "2c7f2f04f16e4573a4efa13bd427af90"
format_stamp: "Formatted at 2026-08-12 21:01:09 on dist-test-slave-h3ft"
server_key: "d29e0ccd422d77138873a32c6e1ef2c8"
server_key_iv: "56a789f9eed9a609b69cf5d59a5f1248"
server_key_version: "encryptionkey@0"
I20260812 21:01:09.504021 1524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "2c7f2f04f16e4573a4efa13bd427af90"
format_stamp: "Formatted at 2026-08-12 21:01:09 on dist-test-slave-h3ft"
server_key: "d29e0ccd422d77138873a32c6e1ef2c8"
server_key_iv: "56a789f9eed9a609b69cf5d59a5f1248"
server_key_version: "encryptionkey@0"
I20260812 21:01:09.505788 1524 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 21:01:09.506990 1543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:09.507397 1524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:09.507539 1524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "2c7f2f04f16e4573a4efa13bd427af90"
format_stamp: "Formatted at 2026-08-12 21:01:09 on dist-test-slave-h3ft"
server_key: "d29e0ccd422d77138873a32c6e1ef2c8"
server_key_iv: "56a789f9eed9a609b69cf5d59a5f1248"
server_key_version: "encryptionkey@0"
I20260812 21:01:09.507655 1524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:09.528017 1524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:09.530752 1524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:09.530972 1524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:09.536600 1524 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:46197
I20260812 21:01:09.536638 1631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:46197 every 8 connection(s)
I20260812 21:01:09.537112 1524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:01:09.537554 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 1524
I20260812 21:01:09.537695 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:01:09.537969 10361 external_mini_cluster.cc:1428] Setting key f8b426e768075d39a25989064434d8e2
I20260812 21:01:09.538403 1633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:09.542639 1633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90: Bootstrap starting.
I20260812 21:01:09.543612 1633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:09.544000 1633 log.cc:824] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:09.545136 1633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90: No bootstrap required, opened a new log
Aug 12 21:01:09 dist-test-slave-h3ft krb5kdc[1505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:09.548204 1633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7f2f04f16e4573a4efa13bd427af90" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46197 } }
I20260812 21:01:09.548462 1633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:09.548511 1633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c7f2f04f16e4573a4efa13bd427af90, State: Initialized, Role: FOLLOWER
I20260812 21:01:09.548698 1633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7f2f04f16e4573a4efa13bd427af90" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46197 } }
I20260812 21:01:09.548828 1633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:01:09.548905 1633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:01:09.548990 1633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:09.550084 1633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7f2f04f16e4573a4efa13bd427af90" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46197 } }
I20260812 21:01:09.550246 1633 leader_election.cc:302] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c7f2f04f16e4573a4efa13bd427af90; no voters:
I20260812 21:01:09.550489 1633 leader_election.cc:288] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:01:09.550570 1642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:09.550799 1642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [term 1 LEADER]: Becoming Leader. State: Replica: 2c7f2f04f16e4573a4efa13bd427af90, State: Running, Role: LEADER
I20260812 21:01:09.550940 1633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:09.550933 1642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7f2f04f16e4573a4efa13bd427af90" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46197 } }
I20260812 21:01:09.552273 1644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c7f2f04f16e4573a4efa13bd427af90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7f2f04f16e4573a4efa13bd427af90" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46197 } } }
I20260812 21:01:09.552537 1647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c7f2f04f16e4573a4efa13bd427af90. Latest consensus state: current_term: 1 leader_uuid: "2c7f2f04f16e4573a4efa13bd427af90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7f2f04f16e4573a4efa13bd427af90" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46197 } } }
I20260812 21:01:09.552917 1644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:09.552987 1647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:09.553400 1638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:09.538635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49868 (local address 127.10.30.126:46197)
0812 21:01:09.538851 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:09.538862 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:09.538906 (+ 44us) server_negotiation.cc:407] Connection header received
0812 21:01:09.539883 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:09.539898 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:09.539969 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:09.540134 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:09.541147 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:09.542268 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:09.543441 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:09.544011 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:09.544142 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:09.547429 (+ 3287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:09.547437 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:09.547437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:09.547457 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:09.550169 (+ 2712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:09.550855 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:09.550860 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:09.550861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:09.551061 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:09.551346 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:09.551347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:09.551347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:09.551745 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:09.552584 (+ 839us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:09.552676 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 21:01:09.552894 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
W20260812 21:01:09.553536 1667 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:01:09.553798 1667 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:01:09.553902 1673 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:01:09.554140 1673 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:01:09.554984 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:01:09.556145 1673 catalog_manager.cc:1347] Generated new cluster ID: e4bb6490e9764c06a7af89cdc7e12909
I20260812 21:01:09.556205 1673 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:01:09.565155 1673 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:01:09.565833 1673 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:01:09.568699 1673 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c7f2f04f16e4573a4efa13bd427af90: Generated new TSK 0
I20260812 21:01:09.568953 1673 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:01:09.610306 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 1524
2026-08-12T21:01:09Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1810 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:01:09 dist-test-slave-h3ft krb5kdc[1687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:01:09 dist-test-slave-h3ft krb5kdc[1687](info): set up 2 sockets
Aug 12 21:01:09 dist-test-slave-h3ft krb5kdc[1687](info): commencing operation
krb5kdc: starting...
W20260812 21:01:10.997547 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.353s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:01:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:01:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:01:11.159796 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43701
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:43701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:11.256987 1705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:11.257339 1705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:11.257386 1705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:11.258889 1705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:11.259021 1705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:11.259053 1705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:11.259078 1705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:11.259109 1705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:11.260972 1705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:43701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:11.261340 1705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:11.261641 1705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:11.267604 1714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:11.267599 1719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:11.267642 1713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:11.268203 1705 server_base.cc:1034] running on GCE node
I20260812 21:01:11.268604 1705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:11.268996 1705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:11.270218 1705 hybrid_clock.cc:648] HybridClock initialized: now 1786568471270209 us; error 58 us; skew 500 ppm
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:11.273468 1705 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:01:11.274158 1705 webserver.cc:460] Webserver started at http://127.10.30.126:35669/ using document root <none> and password file <none>
I20260812 21:01:11.274462 1705 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:11.274551 1705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:11.274748 1705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:11.276230 1705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "e6f06c982df149c6a194e79dc8a23834"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "b303fa61a4ec008f6c66756783543c2f"
server_key_iv: "26e1a95c4b01e1a02411764a9364e038"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.276716 1705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "e6f06c982df149c6a194e79dc8a23834"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "b303fa61a4ec008f6c66756783543c2f"
server_key_iv: "26e1a95c4b01e1a02411764a9364e038"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.278445 1705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 21:01:11.279564 1734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.279806 1705 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 21:01:11.279939 1705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "e6f06c982df149c6a194e79dc8a23834"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "b303fa61a4ec008f6c66756783543c2f"
server_key_iv: "26e1a95c4b01e1a02411764a9364e038"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.280031 1705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:11.287822 1705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:11.290565 1705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:11.290759 1705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:11.296332 1705 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:43701
I20260812 21:01:11.296363 1818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:43701 every 8 connection(s)
I20260812 21:01:11.296875 1705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:01:11.297780 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 1705
I20260812 21:01:11.298035 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:01:11.298332 10361 external_mini_cluster.cc:1428] Setting key 9929d04b8ec62aa5464c5f4da97e1605
I20260812 21:01:11.298440 1821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:11.302982 1821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Bootstrap starting.
I20260812 21:01:11.303917 1821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:11.304296 1821 log.cc:824] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:11.305174 1821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: No bootstrap required, opened a new log
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:11.307562 1821 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:11.307775 1821 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:11.307852 1821 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f06c982df149c6a194e79dc8a23834, State: Initialized, Role: FOLLOWER
I20260812 21:01:11.308060 1821 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:11.308183 1821 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:01:11.308234 1821 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:01:11.308292 1821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:11.309024 1821 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:11.309165 1821 leader_election.cc:302] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6f06c982df149c6a194e79dc8a23834; no voters:
I20260812 21:01:11.309406 1821 leader_election.cc:288] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:01:11.309482 1830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:11.309665 1830 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 1 LEADER]: Becoming Leader. State: Replica: e6f06c982df149c6a194e79dc8a23834, State: Running, Role: LEADER
I20260812 21:01:11.309774 1821 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:11.309880 1830 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:11.310390 1834 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6f06c982df149c6a194e79dc8a23834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } } }
I20260812 21:01:11.310489 1834 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:11.310670 1834 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6f06c982df149c6a194e79dc8a23834. Latest consensus state: current_term: 1 leader_uuid: "e6f06c982df149c6a194e79dc8a23834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } } }
I20260812 21:01:11.310736 1834 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:11.311311 1844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:01:11.312052 1844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:01:11.312584 1826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.299108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57480 (local address 127.10.30.126:43701)
0812 21:01:11.299355 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:11.299365 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:11.299399 (+ 34us) server_negotiation.cc:407] Connection header received
0812 21:01:11.300129 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:11.300139 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:11.300204 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:11.300364 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:11.301379 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.302457 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.303642 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.304326 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.304500 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.307722 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:11.307727 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:11.307728 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:11.307743 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:11.310332 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.310907 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.310910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.310911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.311127 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.311413 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.311414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.311414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.311818 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:11.312019 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:11.312178 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 21:01:11.312344 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":103,"threads_started":1}
I20260812 21:01:11.314245 1844 catalog_manager.cc:1347] Generated new cluster ID: 94b846f8456443858827a36b372c4e30
I20260812 21:01:11.314314 1844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:01:11.334784 1844 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:01:11.335592 1844 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:01:11.338692 1844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Generated new TSK 0
I20260812 21:01:11.338943 1844 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 21:01:11.379669 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43701
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:11.478245 1865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:11.478534 1865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:11.478566 1865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:11.479871 1865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:11.479908 1865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:11.479936 1865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:01:11.481524 1865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:11.481773 1865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:11.482017 1865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:11.487874 1874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:11.488004 1877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:11.488078 1875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:11.488317 1865 server_base.cc:1034] running on GCE node
I20260812 21:01:11.488544 1865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:11.488785 1865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:11.489974 1865 hybrid_clock.cc:648] HybridClock initialized: now 1786568471489956 us; error 33 us; skew 500 ppm
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:11.493299 1865 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:01:11.493865 1865 webserver.cc:460] Webserver started at http://127.10.30.65:37095/ using document root <none> and password file <none>
I20260812 21:01:11.494210 1865 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:11.494264 1865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:11.494447 1865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:11.495769 1865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "7213f6138b434b558ec3e9bc50c979b6"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "c519a05685fc6eaf8eedd531587dbed6"
server_key_iv: "fe13a78f9ac34e08d0eadccbb95b98e1"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.496238 1865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "7213f6138b434b558ec3e9bc50c979b6"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "c519a05685fc6eaf8eedd531587dbed6"
server_key_iv: "fe13a78f9ac34e08d0eadccbb95b98e1"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.497844 1865 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:01:11.498754 1892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.499058 1865 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:11.499190 1865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "7213f6138b434b558ec3e9bc50c979b6"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "c519a05685fc6eaf8eedd531587dbed6"
server_key_iv: "fe13a78f9ac34e08d0eadccbb95b98e1"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.499274 1865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:11.514302 1865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:11.516695 1865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:11.516891 1865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:11.517211 1865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:11.517607 1865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:11.517668 1865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.517719 1865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:11.517750 1865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.525038 1865 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:45987
I20260812 21:01:11.525185 2117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:45987 every 8 connection(s)
I20260812 21:01:11.525544 1865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:01:11.527753 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 1865
I20260812 21:01:11.527873 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:01:11.528138 10361 external_mini_cluster.cc:1428] Setting key ef338a7cafd64485a4c7ff1b725794fc
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:11.538328 1826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.526504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:59141 (local address 127.10.30.126:43701)
0812 21:01:11.526606 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:11.526608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:11.526785 (+ 177us) server_negotiation.cc:407] Connection header received
0812 21:01:11.527510 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:11.527511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:11.527528 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:11.527609 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:11.529005 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.529814 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.531044 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.531405 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.531493 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.534781 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:11.534782 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:11.534783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:11.534791 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:11.536578 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.537112 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.537114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.537115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.537193 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.537500 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.537501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.537501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.537660 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:11.537752 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:11.538094 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 21:01:11.538208 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 21:01:11.538596 2123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.526438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:59141)
0812 21:01:11.526632 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:11.526683 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:11.527351 (+ 668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:11.527689 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:11.527693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:11.528624 (+ 931us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:11.528876 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.528883 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.529952 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.529953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.530903 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.530906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.531551 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.531561 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.531759 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.532505 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:11.532520 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:11.534638 (+ 2118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:11.536704 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:11.536718 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:11.536721 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:11.537021 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:11.537275 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:11.537276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:11.537276 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:11.537423 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:11.537738 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:11.537748 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:11.537937 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 21:01:11.538070 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 21:01:11.538283 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":111,"threads_started":1}
I20260812 21:01:11.539336 2119 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43701
I20260812 21:01:11.539471 2119 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:11.539736 2119 heartbeater.cc:511] Master 127.10.30.126:43701 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
I20260812 21:01:11.540534 1762 ts_manager.cc:194] Registered new tserver with Master: 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987)
I20260812 21:01:11.541319 1762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:59141
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 21:01:11.566798 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43701
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:11.666114 2126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:11.666455 2126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:11.666507 2126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:11.667893 2126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:11.667990 2126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:11.668043 2126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:01:11.669783 2126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:11.670145 2126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:11.670452 2126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:11.676697 2139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:11.676687 2135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:11.676695 2136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:11.677110 2126 server_base.cc:1034] running on GCE node
I20260812 21:01:11.677342 2126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:11.677635 2126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:11.678889 2126 hybrid_clock.cc:648] HybridClock initialized: now 1786568471678870 us; error 36 us; skew 500 ppm
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:11.682291 2126 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:01:11.682919 2126 webserver.cc:460] Webserver started at http://127.10.30.66:33265/ using document root <none> and password file <none>
I20260812 21:01:11.683280 2126 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:11.683413 2126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:11.683594 2126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:11.685039 2126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "44d06915848f49da96e6099217f1bf27"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "e259aa279983d21fa998d3c41d3917f0"
server_key_iv: "7e82ee1bd8e812f7caa69ede710a10cb"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.685477 2126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "44d06915848f49da96e6099217f1bf27"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "e259aa279983d21fa998d3c41d3917f0"
server_key_iv: "7e82ee1bd8e812f7caa69ede710a10cb"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.687227 2126 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 21:01:11.688268 2158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.688570 2126 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:11.688719 2126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "44d06915848f49da96e6099217f1bf27"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "e259aa279983d21fa998d3c41d3917f0"
server_key_iv: "7e82ee1bd8e812f7caa69ede710a10cb"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.688822 2126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:11.708694 2126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:11.712260 2126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:11.712495 2126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:11.712869 2126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:11.713311 2126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:11.713380 2126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.713435 2126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:11.713490 2126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.721932 2126 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:45141
I20260812 21:01:11.722015 2354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:45141 every 8 connection(s)
I20260812 21:01:11.722448 2126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:01:11.725145 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 2126
I20260812 21:01:11.725334 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:01:11.725574 10361 external_mini_cluster.cc:1428] Setting key c873800db3a9f83583b2f9ee37133dda
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:11.735285 1826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.723442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:36573 (local address 127.10.30.126:43701)
0812 21:01:11.723525 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:11.723528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:11.723821 (+ 293us) server_negotiation.cc:407] Connection header received
0812 21:01:11.724500 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:11.724502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:11.724516 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:11.724595 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:11.725959 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.726640 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.727833 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.728066 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.728148 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.731293 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:11.731296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:11.731296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:11.731307 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:11.733300 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.733908 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.733909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.733910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.734000 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.734368 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.734369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.734370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.734534 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:11.734627 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:11.735037 (+ 410us) server_negotiation.cc:299] Negotiation successful
0812 21:01:11.735158 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 21:01:11.735565 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.723390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:36573)
0812 21:01:11.723636 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:11.723691 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:11.724368 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:11.724701 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:11.724706 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:11.725510 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:11.725836 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.725843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.726755 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.726756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.727719 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.727724 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.728165 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.728166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.728317 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.729035 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:11.729050 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:11.731173 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:11.733424 (+ 2251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:11.733436 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:11.733440 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:11.733765 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:11.734120 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:11.734121 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:11.734122 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:11.734283 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:11.734614 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:11.734624 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:11.734828 (+ 204us) client_negotiation.cc:769] Sending connection context
0812 21:01:11.734977 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 21:01:11.735242 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":140,"threads_started":1}
I20260812 21:01:11.736238 2356 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43701
I20260812 21:01:11.736384 2356 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:11.736631 2356 heartbeater.cc:511] Master 127.10.30.126:43701 requested a full tablet report, sending...
I20260812 21:01:11.737165 1762 ts_manager.cc:194] Registered new tserver with Master: 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141)
I20260812 21:01:11.737651 1762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:36573
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 21:01:11.763379 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43701
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:11.863291 2365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:11.863590 2365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:11.863623 2365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:11.865095 2365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:11.865147 2365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:11.865180 2365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:01:11.866842 2365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:11.867178 2365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:11.867422 2365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:11.873339 2381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:11.873348 2375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:11.873339 2376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:11.873673 2365 server_base.cc:1034] running on GCE node
I20260812 21:01:11.873945 2365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:11.874267 2365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:11.875428 2365 hybrid_clock.cc:648] HybridClock initialized: now 1786568471875407 us; error 51 us; skew 500 ppm
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:11.878968 2365 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:01:11.879619 2365 webserver.cc:460] Webserver started at http://127.10.30.67:44761/ using document root <none> and password file <none>
I20260812 21:01:11.879905 2365 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:11.879961 2365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:11.880168 2365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:11.881548 2365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "d792fc9524fa403d8536df00748297fd"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "5ad9ca2956a7ddc5d283fafcb1444c86"
server_key_iv: "ab0e1f0b9b0cee1f7d5787506134349f"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.882030 2365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "d792fc9524fa403d8536df00748297fd"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "5ad9ca2956a7ddc5d283fafcb1444c86"
server_key_iv: "ab0e1f0b9b0cee1f7d5787506134349f"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.883970 2365 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:01:11.885066 2392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.885322 2365 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:11.885449 2365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "d792fc9524fa403d8536df00748297fd"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "5ad9ca2956a7ddc5d283fafcb1444c86"
server_key_iv: "ab0e1f0b9b0cee1f7d5787506134349f"
server_key_version: "encryptionkey@0"
I20260812 21:01:11.885542 2365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:11.905741 2365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:11.909016 2365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:11.909242 2365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:11.909567 2365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:11.910130 2365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:11.910174 2365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.910202 2365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:11.910215 2365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:11.917785 2365 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:42405
I20260812 21:01:11.917842 2599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:42405 every 8 connection(s)
I20260812 21:01:11.918253 2365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:01:11.921490 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 2365
I20260812 21:01:11.921610 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:01:11.921838 10361 external_mini_cluster.cc:1428] Setting key 70f3e0037c8df7eff8a9d0d69b6e66ac
Aug 12 21:01:11 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568471, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:11.929771 1826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.919152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:49295 (local address 127.10.30.126:43701)
0812 21:01:11.919245 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:11.919248 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:11.919498 (+ 250us) server_negotiation.cc:407] Connection header received
0812 21:01:11.920155 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:11.920157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:11.920173 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:11.920242 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:11.921437 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.922147 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.923646 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.923878 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.923959 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.926640 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:11.926642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:11.926642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:11.926657 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:11.928230 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.928696 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.928698 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.928698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.928763 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.929041 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.929042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.929042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.929180 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:11.929258 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:11.929563 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 21:01:11.929657 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 21:01:11.930028 2602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.919068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:49295)
0812 21:01:11.919316 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:11.919370 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:11.920028 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:11.920328 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:11.920332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:11.921030 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:11.921313 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.921319 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.922261 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.922262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.923537 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.923540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.923984 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.923985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.924111 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.924744 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:11.924754 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:11.926517 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:11.928337 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:11.928346 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:11.928348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:11.928607 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:11.928831 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:11.928832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:11.928833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:11.928965 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:11.929246 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:11.929255 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:11.929419 (+ 164us) client_negotiation.cc:769] Sending connection context
0812 21:01:11.929540 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 21:01:11.929732 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":115,"threads_started":1}
I20260812 21:01:11.930613 2600 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43701
I20260812 21:01:11.930718 2600 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:11.930986 2600 heartbeater.cc:511] Master 127.10.30.126:43701 requested a full tablet report, sending...
I20260812 21:01:11.931563 1762 ts_manager.cc:194] Registered new tserver with Master: d792fc9524fa403d8536df00748297fd (127.10.30.67:42405)
I20260812 21:01:11.931996 1762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:49295
I20260812 21:01:11.934074 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:01:11.942945 1826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.935891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.10.30.126:43701)
0812 21:01:11.935945 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:11.935947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:11.936146 (+ 199us) server_negotiation.cc:407] Connection header received
0812 21:01:11.936179 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:11.936180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:11.936192 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:11.936253 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:11.936953 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.937515 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.938309 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.938510 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.938571 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.940042 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:11.940043 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:11.940044 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:11.940051 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:11.941710 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.942123 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.942124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.942124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.942191 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:11.942393 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:11.942393 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:11.942393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:11.942588 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:11.942676 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:11.942786 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 21:01:11.942861 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 21:01:11.945230 1762 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:01:11.947494 1762 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:01:11.955659 2626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.950780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:45141 (local address 127.0.0.1:44162)
0812 21:01:11.951307 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:11.951345 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:11.951432 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:11.951889 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:11.951893 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:11.951896 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:11.951999 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.952001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.953126 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.953127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.954343 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.954346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.955273 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.955275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.955369 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.955387 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 21:01:11.955474 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 21:01:11.955538 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":50,"spinlock_wait_cycles":768,"thread_start_us":118,"threads_started":1}
I20260812 21:01:11.955667 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.950939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44162 (local address 127.10.30.66:45141)
0812 21:01:11.951389 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:11.951395 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:11.951410 (+ 15us) server_negotiation.cc:407] Connection header received
0812 21:01:11.951680 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:11.951686 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:11.951708 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:11.951812 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:11.952101 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.952998 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.954442 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.955172 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.955258 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.955332 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:11.955506 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 21:01:11.955560 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":188,"threads_started":1}
I20260812 21:01:11.956250 2620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.950779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:45987 (local address 127.0.0.1:47822)
0812 21:01:11.951051 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:11.951515 (+ 464us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:11.951603 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:11.952297 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:11.952298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:11.952301 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:11.952355 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.952356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.953620 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.953621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.954789 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.954792 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.955970 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.955971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.956047 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.956053 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:01:11.956104 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 21:01:11.956156 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":89,"threads_started":1}
I20260812 21:01:11.956640 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.951103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47822 (local address 127.10.30.65:45987)
0812 21:01:11.952114 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:11.952119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:11.952129 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:01:11.952177 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:11.952179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:11.952197 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:11.952285 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:11.952424 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.953499 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.954902 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.955775 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.955856 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.955928 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:11.956457 (+ 529us) server_negotiation.cc:299] Negotiation successful
0812 21:01:11.956548 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":958,"thread_start_us":101,"threads_started":1}
I20260812 21:01:11.957012 2629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.951128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42405 (local address 127.0.0.1:36122)
0812 21:01:11.951323 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:11.951358 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:11.951433 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:11.951925 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:11.951926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:11.951928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:11.951998 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.952001 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.953470 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.953470 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.954917 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:11.954920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.956531 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.956532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:11.956625 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.956630 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:01:11.956866 (+ 236us) client_negotiation.cc:240] Negotiation successful
0812 21:01:11.956926 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":39,"thread_start_us":115,"threads_started":1}
I20260812 21:01:11.956877 2244 tablet_service.cc:1467] Processing CreateTablet for tablet 828dc26d7b2f4eb68c0a621b6163e5a6 (DEFAULT_TABLE table=test-table [id=6133439aa62647a8beee9738e43d1152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:11.957181 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:11.951268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36122 (local address 127.10.30.67:42405)
0812 21:01:11.951730 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:11.951735 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:11.951746 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:01:11.951800 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:11.951802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:11.951819 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:11.951928 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:11.952105 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.953332 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.955038 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:11.956449 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:11.956527 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:11.956586 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:11.957001 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 21:01:11.957082 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":140,"threads_started":1}
I20260812 21:01:11.957409 2244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 828dc26d7b2f4eb68c0a621b6163e5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:11.957525 1982 tablet_service.cc:1467] Processing CreateTablet for tablet 828dc26d7b2f4eb68c0a621b6163e5a6 (DEFAULT_TABLE table=test-table [id=6133439aa62647a8beee9738e43d1152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:11.957904 1982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 828dc26d7b2f4eb68c0a621b6163e5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:11.959970 2478 tablet_service.cc:1467] Processing CreateTablet for tablet 828dc26d7b2f4eb68c0a621b6163e5a6 (DEFAULT_TABLE table=test-table [id=6133439aa62647a8beee9738e43d1152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:11.960400 2478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 828dc26d7b2f4eb68c0a621b6163e5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:11.962051 2631 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Bootstrap starting.
I20260812 21:01:11.962348 2633 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Bootstrap starting.
I20260812 21:01:11.963300 2633 tablet_bootstrap.cc:654] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:11.963761 2631 tablet_bootstrap.cc:654] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:11.964059 2633 log.cc:824] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:11.964371 2634 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: Bootstrap starting.
I20260812 21:01:11.964443 2631 log.cc:824] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:11.965320 2634 tablet_bootstrap.cc:654] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:11.965535 2631 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: No bootstrap required, opened a new log
I20260812 21:01:11.965632 2631 ts_tablet_manager.cc:1397] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 21:01:11.965978 2634 log.cc:824] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:11.966923 2634 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: No bootstrap required, opened a new log
I20260812 21:01:11.967036 2634 ts_tablet_manager.cc:1397] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:01:11.967468 2633 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: No bootstrap required, opened a new log
I20260812 21:01:11.967584 2633 ts_tablet_manager.cc:1397] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 21:01:11.968212 2631 raft_consensus.cc:348] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:11.968436 2631 raft_consensus.cc:374] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:11.968490 2631 raft_consensus.cc:729] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44d06915848f49da96e6099217f1bf27, State: Initialized, Role: FOLLOWER
I20260812 21:01:11.968675 2631 consensus_queue.cc:260] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:11.969074 2631 ts_tablet_manager.cc:1428] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 21:01:11.969099 2356 heartbeater.cc:503] Master 127.10.30.126:43701 was elected leader, sending a full tablet report...
I20260812 21:01:11.969385 2634 raft_consensus.cc:348] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:11.969518 2634 raft_consensus.cc:374] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:11.969549 2634 raft_consensus.cc:729] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d792fc9524fa403d8536df00748297fd, State: Initialized, Role: FOLLOWER
I20260812 21:01:11.969681 2634 consensus_queue.cc:260] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:11.969853 2633 raft_consensus.cc:348] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:11.970026 2634 ts_tablet_manager.cc:1428] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:01:11.970064 2600 heartbeater.cc:503] Master 127.10.30.126:43701 was elected leader, sending a full tablet report...
I20260812 21:01:11.970074 2633 raft_consensus.cc:374] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:11.970113 2633 raft_consensus.cc:729] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7213f6138b434b558ec3e9bc50c979b6, State: Initialized, Role: FOLLOWER
I20260812 21:01:11.970238 2633 consensus_queue.cc:260] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:11.970557 2633 ts_tablet_manager.cc:1428] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:01:11.970786 2119 heartbeater.cc:503] Master 127.10.30.126:43701 was elected leader, sending a full tablet report...
W20260812 21:01:11.973258 2358 tablet.cc:2369] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:01:12.026613 2122 tablet.cc:2369] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:01:12.063330 2642 raft_consensus.cc:482] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:12.063537 2642 raft_consensus.cc:504] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:12.064189 2642 leader_election.cc:288] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987), d792fc9524fa403d8536df00748297fd (127.10.30.67:42405)
I20260812 21:01:12.069097 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.064420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:45987 (local address 127.10.30.66:49907)
0812 21:01:12.064488 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.064503 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:12.064564 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:12.064913 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:12.064914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:12.064917 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:12.065126 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.065129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.066232 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.066233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.067822 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.067826 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.068731 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.068733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.068906 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.068911 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:01:12.068968 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 21:01:12.069021 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":224}
I20260812 21:01:12.069155 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.064651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:58025 (local address 127.10.30.67:42405)
0812 21:01:12.064742 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.064745 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.064755 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:01:12.064790 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.064791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.064803 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.064866 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:12.065271 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.066130 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.067972 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.068625 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.068697 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.068706 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.068995 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.069069 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 21:01:12.069159 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.064593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:49907 (local address 127.10.30.65:45987)
0812 21:01:12.064663 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.064668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.064701 (+ 33us) server_negotiation.cc:407] Connection header received
0812 21:01:12.064746 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.064747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.064764 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.064845 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:12.065277 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.066114 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.067977 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.068589 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.068691 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.068706 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.069012 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.069073 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 21:01:12.069108 2649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.064441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42405 (local address 127.10.30.66:58025)
0812 21:01:12.064687 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.064696 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:12.064747 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:12.064913 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:12.064915 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:12.064917 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:12.065149 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.065151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.066232 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.066233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.067822 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.067826 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.068731 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.068733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.068833 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.068839 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:01:12.068918 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 21:01:12.068986 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":94,"thread_start_us":144,"threads_started":1}
I20260812 21:01:12.069635 2018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "828dc26d7b2f4eb68c0a621b6163e5a6" candidate_uuid: "44d06915848f49da96e6099217f1bf27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7213f6138b434b558ec3e9bc50c979b6" is_pre_election: true
I20260812 21:01:12.069883 2018 raft_consensus.cc:2454] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44d06915848f49da96e6099217f1bf27 in term 0.
I20260812 21:01:12.070076 2518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "828dc26d7b2f4eb68c0a621b6163e5a6" candidate_uuid: "44d06915848f49da96e6099217f1bf27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d792fc9524fa403d8536df00748297fd" is_pre_election: true
I20260812 21:01:12.070291 2518 raft_consensus.cc:2454] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44d06915848f49da96e6099217f1bf27 in term 0.
I20260812 21:01:12.070289 2162 leader_election.cc:302] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44d06915848f49da96e6099217f1bf27, 7213f6138b434b558ec3e9bc50c979b6; no voters:
I20260812 21:01:12.070451 2642 raft_consensus.cc:2781] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:01:12.070578 2642 raft_consensus.cc:482] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:01:12.070619 2642 raft_consensus.cc:3037] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:12.071734 2642 raft_consensus.cc:504] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:12.071942 2642 leader_election.cc:288] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [CANDIDATE]: Term 1 election: Requested vote from peers 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987), d792fc9524fa403d8536df00748297fd (127.10.30.67:42405)
I20260812 21:01:12.072184 2018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "828dc26d7b2f4eb68c0a621b6163e5a6" candidate_uuid: "44d06915848f49da96e6099217f1bf27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7213f6138b434b558ec3e9bc50c979b6"
I20260812 21:01:12.072216 2518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "828dc26d7b2f4eb68c0a621b6163e5a6" candidate_uuid: "44d06915848f49da96e6099217f1bf27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d792fc9524fa403d8536df00748297fd"
I20260812 21:01:12.072310 2518 raft_consensus.cc:3037] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:12.072306 2018 raft_consensus.cc:3037] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:12.073520 2518 raft_consensus.cc:2454] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44d06915848f49da96e6099217f1bf27 in term 1.
I20260812 21:01:12.073520 2018 raft_consensus.cc:2454] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44d06915848f49da96e6099217f1bf27 in term 1.
I20260812 21:01:12.073772 2160 leader_election.cc:302] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44d06915848f49da96e6099217f1bf27, d792fc9524fa403d8536df00748297fd; no voters:
I20260812 21:01:12.073885 2642 raft_consensus.cc:2781] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:12.074110 2642 raft_consensus.cc:686] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 1 LEADER]: Becoming Leader. State: Replica: 44d06915848f49da96e6099217f1bf27, State: Running, Role: LEADER
I20260812 21:01:12.074240 2642 consensus_queue.cc:237] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:12.075542 1762 catalog_manager.cc:5495] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44d06915848f49da96e6099217f1bf27 (127.10.30.66). New cstate: current_term: 1 leader_uuid: "44d06915848f49da96e6099217f1bf27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } health_report { overall_health: UNKNOWN } } }
I20260812 21:01:12.082228 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.079232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44164 (local address 127.10.30.66:45141)
0812 21:01:12.079307 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.079309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.079318 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:01:12.079372 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.079373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.079396 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.079475 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:01:12.079684 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.080313 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.081230 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.081473 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.081550 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.081783 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:01:12.081921 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:01:12.082089 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.082108 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.082141 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 21:01:12.085090 2518 raft_consensus.cc:1261] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 1 FOLLOWER]: Refusing update from remote peer 44d06915848f49da96e6099217f1bf27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:12.085112 2018 raft_consensus.cc:1261] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Refusing update from remote peer 44d06915848f49da96e6099217f1bf27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:12.085532 2651 consensus_queue.cc:1035] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:12.085716 2642 consensus_queue.cc:1035] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:12.089421 2657 mvcc.cc:205] Tried to move back new op lower bound from 7317784461656543232 to 7317784461617025024. Current Snapshot: MvccSnapshot[applied={T|T < 7317784461656543232}]
I20260812 21:01:12.092660 1760 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:12.092823 1760 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:12.093883 1760 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Sending DeleteTablet for 3 replicas of tablet 828dc26d7b2f4eb68c0a621b6163e5a6
I20260812 21:01:12.094388 1982 tablet_service.cc:1514] Processing DeleteTablet for tablet 828dc26d7b2f4eb68c0a621b6163e5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:12 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:47822
I20260812 21:01:12.094419 2478 tablet_service.cc:1514] Processing DeleteTablet for tablet 828dc26d7b2f4eb68c0a621b6163e5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:12 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:36122
I20260812 21:01:12.094826 2244 tablet_service.cc:1514] Processing DeleteTablet for tablet 828dc26d7b2f4eb68c0a621b6163e5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:12 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:44162
I20260812 21:01:12.095031 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 1865
I20260812 21:01:12.099241 2675 tablet_replica.cc:330] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: stopping tablet replica
I20260812 21:01:12.099463 2675 raft_consensus.cc:2229] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:01:12.099642 2675 raft_consensus.cc:2258] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:12.108489 2675 ts_tablet_manager.cc:1905] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:12.112644 2675 ts_tablet_manager.cc:1918] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:12.112805 2675 log.cc:1196] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/828dc26d7b2f4eb68c0a621b6163e5a6
I20260812 21:01:12.113224 2675 ts_tablet_manager.cc:1939] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 44d06915848f49da96e6099217f1bf27: Deleting consensus metadata
I20260812 21:01:12.113986 1737 catalog_manager.cc:4841] TS 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141): tablet 828dc26d7b2f4eb68c0a621b6163e5a6 (table test-table [id=6133439aa62647a8beee9738e43d1152]) successfully deleted
I20260812 21:01:12.114709 2672 tablet_replica.cc:330] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: stopping tablet replica
I20260812 21:01:12.114929 2672 raft_consensus.cc:2229] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:12.115163 2672 raft_consensus.cc:2258] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:12.115737 2672 ts_tablet_manager.cc:1905] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:12.123318 2672 ts_tablet_manager.cc:1918] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:12.123502 2672 log.cc:1196] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/828dc26d7b2f4eb68c0a621b6163e5a6
I20260812 21:01:12.123878 2672 ts_tablet_manager.cc:1939] T 828dc26d7b2f4eb68c0a621b6163e5a6 P d792fc9524fa403d8536df00748297fd: Deleting consensus metadata
I20260812 21:01:12.124624 1737 catalog_manager.cc:4841] TS d792fc9524fa403d8536df00748297fd (127.10.30.67:42405): tablet 828dc26d7b2f4eb68c0a621b6163e5a6 (table test-table [id=6133439aa62647a8beee9738e43d1152]) successfully deleted
W20260812 21:01:12.125727 1740 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:45987 (error 108)
I20260812 21:01:12.126489 2629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.126300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:45987 (local address 127.0.0.1:47832)
0812 21:01:12.126392 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.126443 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 21:01:12.126629 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 2126
W20260812 21:01:12.140707 1740 catalog_manager.cc:4584] TS 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 828dc26d7b2f4eb68c0a621b6163e5a6: Network error: Client connection negotiation failed: client connection to 127.10.30.65:45987: connect: Connection refused (error 111)
I20260812 21:01:12.156277 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 2365
I20260812 21:01:12.180541 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 1705
I20260812 21:01:12.199206 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43701
--webserver_interface=127.10.30.126
--webserver_port=35669
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:43701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:12.303303 2678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:12.303584 2678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:12.303613 2678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:12.304937 2678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:12.304991 2678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:12.305012 2678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:12.305027 2678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:12.305039 2678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:12.306685 2678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:43701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=35669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:12.306957 2678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:12.307273 2678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:12.318631 2692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:12.318657 2699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:12.318660 2693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:12.319058 2678 server_base.cc:1034] running on GCE node
I20260812 21:01:12.319439 2678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:12.319829 2678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:12.321043 2678 hybrid_clock.cc:648] HybridClock initialized: now 1786568472321020 us; error 42 us; skew 500 ppm
Aug 12 21:01:12 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568472, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:12.324414 2678 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:01:12.325112 2678 webserver.cc:460] Webserver started at http://127.10.30.126:35669/ using document root <none> and password file <none>
I20260812 21:01:12.325412 2678 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:12.325505 2678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:12.327286 2678 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:01:12.328169 2712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:12.328495 2678 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:12.328629 2678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "e6f06c982df149c6a194e79dc8a23834"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "b303fa61a4ec008f6c66756783543c2f"
server_key_iv: "26e1a95c4b01e1a02411764a9364e038"
server_key_version: "encryptionkey@0"
I20260812 21:01:12.329217 2678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:12.343257 2678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:12.345849 2678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:12.346096 2678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:12.351725 2678 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:43701
I20260812 21:01:12.351761 2811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:43701 every 8 connection(s)
I20260812 21:01:12.352299 2678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:01:12.354642 2812 sys_catalog.cc:263] Verifying existing consensus state
I20260812 21:01:12.355755 2812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Bootstrap starting.
I20260812 21:01:12.359073 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 2678
I20260812 21:01:12.359558 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:45987
--local_ip_for_outbound_sockets=127.10.30.65
--tserver_master_addrs=127.10.30.126:43701
--webserver_port=37095
--webserver_interface=127.10.30.65
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:12.369331 2812 log.cc:824] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:12.371991 2812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:01:12.372417 2812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Bootstrap complete.
I20260812 21:01:12.375689 2812 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:12.376008 2812 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f06c982df149c6a194e79dc8a23834, State: Initialized, Role: FOLLOWER
I20260812 21:01:12.376240 2812 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:12.376338 2812 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:01:12.376408 2812 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:01:12.376499 2812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 1 FOLLOWER]: Advancing to term 2
I20260812 21:01:12.377835 2812 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:12.378073 2812 leader_election.cc:302] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6f06c982df149c6a194e79dc8a23834; no voters:
I20260812 21:01:12.378348 2812 leader_election.cc:288] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 21:01:12.378405 2821 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 21:01:12.378558 2821 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 2 LEADER]: Becoming Leader. State: Replica: e6f06c982df149c6a194e79dc8a23834, State: Running, Role: LEADER
I20260812 21:01:12.378666 2821 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:12.378734 2812 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:12.379117 2821 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6f06c982df149c6a194e79dc8a23834. Latest consensus state: current_term: 2 leader_uuid: "e6f06c982df149c6a194e79dc8a23834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } } }
I20260812 21:01:12.379220 2821 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:12.379554 2823 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e6f06c982df149c6a194e79dc8a23834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } } }
I20260812 21:01:12.379758 2823 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:12.379576 2828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:01:12.381008 2828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:01:12.381165 2828 catalog_manager.cc:1259] Loaded cluster ID: 94b846f8456443858827a36b372c4e30
I20260812 21:01:12.381438 2828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:01:12.381727 2828 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 21:01:12.385197 2828 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 21:01:12.388311 2828 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:01:12.388629 2828 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Loaded TSK: 0
I20260812 21:01:12.388893 2828 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 21:01:12.474906 2818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:12.475277 2818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:12.475324 2818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:12.476601 2818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:12.476676 2818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:12.476728 2818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:01:12.478443 2818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:45987
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=37095
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:12.478758 2818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:12.479166 2818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:12.486337 2858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:12.486331 2860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:12.486425 2862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:12.486974 2818 server_base.cc:1034] running on GCE node
I20260812 21:01:12.487253 2818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:12.487571 2818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:12.488763 2818 hybrid_clock.cc:648] HybridClock initialized: now 1786568472488738 us; error 42 us; skew 500 ppm
Aug 12 21:01:12 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568472, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:12.491926 2818 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:01:12.492538 2818 webserver.cc:460] Webserver started at http://127.10.30.65:37095/ using document root <none> and password file <none>
I20260812 21:01:12.492853 2818 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:12.492919 2818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:12.494529 2818 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:01:12.495384 2875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:12.495671 2818 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:01:12.495792 2818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "7213f6138b434b558ec3e9bc50c979b6"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "c519a05685fc6eaf8eedd531587dbed6"
server_key_iv: "fe13a78f9ac34e08d0eadccbb95b98e1"
server_key_version: "encryptionkey@0"
I20260812 21:01:12.496245 2818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:12.511329 2818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:12.513998 2818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:12.514197 2818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:12.514561 2818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:12.515169 2882 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 21:01:12.517508 2818 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 21:01:12.517592 2818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260812 21:01:12.517649 2818 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 21:01:12.518438 2818 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 21:01:12.518519 2818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 21:01:12.518590 2882 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Bootstrap starting.
I20260812 21:01:12.528834 2818 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:45987
I20260812 21:01:12.529497 2818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:01:12.535030 2882 log.cc:824] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:12.538473 2882 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:01:12.538448 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 2818
I20260812 21:01:12.538851 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:45141
--local_ip_for_outbound_sockets=127.10.30.66
--tserver_master_addrs=127.10.30.126:43701
--webserver_port=33265
--webserver_interface=127.10.30.66
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:12.539263 3071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:45987 every 8 connection(s)
I20260812 21:01:12.539364 2882 tablet_bootstrap.cc:492] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Bootstrap complete.
Aug 12 21:01:12 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568472, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:12.542989 2882 ts_tablet_manager.cc:1397] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.014s
I20260812 21:01:12.544340 2882 raft_consensus.cc:348] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:12.544670 2882 raft_consensus.cc:729] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7213f6138b434b558ec3e9bc50c979b6, State: Initialized, Role: FOLLOWER
I20260812 21:01:12.544904 2882 consensus_queue.cc:260] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } } peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } }
I20260812 21:01:12.545305 2882 ts_tablet_manager.cc:1428] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 21:01:12.546751 3075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.530580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:42845)
0812 21:01:12.531082 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.531135 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:12.532052 (+ 917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:12.533083 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:12.533088 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:12.533733 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:12.534138 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.534147 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.536115 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.536116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.537481 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.537484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.538427 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.538428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.538591 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.539344 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:12.539354 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:12.541925 (+ 2571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:12.544655 (+ 2730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:12.544662 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:12.544665 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:12.545046 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:12.545390 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:12.545391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:12.545392 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:12.545537 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:12.545997 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:12.546005 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:12.546165 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 21:01:12.546279 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 21:01:12.546526 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":143,"threads_started":1}
I20260812 21:01:12.546751 3076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.530665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:42845 (local address 127.10.30.126:43701)
0812 21:01:12.530934 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.530945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.531312 (+ 367us) server_negotiation.cc:407] Connection header received
0812 21:01:12.532411 (+ 1099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.532420 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.532633 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.532852 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:12.534352 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.535950 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.537604 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.538245 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.538939 (+ 694us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.542067 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:12.542073 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:12.542073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:12.542090 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:12.544541 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:12.545163 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:12.545167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:12.545168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:12.545306 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:12.545619 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:12.545621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:12.545621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:12.545896 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:12.546024 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.546364 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.546526 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":122,"threads_started":1}
I20260812 21:01:12.547575 3072 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43701
I20260812 21:01:12.547684 3072 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:12.547884 3072 heartbeater.cc:511] Master 127.10.30.126:43701 requested a full tablet report, sending...
I20260812 21:01:12.548849 2744 ts_manager.cc:194] Registered new tserver with Master: 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987)
I20260812 21:01:12.550134 2744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:42845
I20260812 21:01:12.551469 3072 heartbeater.cc:503] Master 127.10.30.126:43701 was elected leader, sending a full tablet report...
I20260812 21:01:12.555459 3081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.549604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:45987 (local address 127.0.0.1:47836)
0812 21:01:12.550650 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.550702 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:12.550816 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:12.551410 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:12.551414 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:12.551418 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:12.551512 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.551514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.553000 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.553000 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.553862 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.553864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.555153 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.555155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.555256 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.555271 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 21:01:12.555339 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 21:01:12.555390 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1004,"thread_start_us":119,"threads_started":1}
I20260812 21:01:12.555544 3083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.550496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47836 (local address 127.10.30.65:45987)
0812 21:01:12.550688 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.550694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.551072 (+ 378us) server_negotiation.cc:407] Connection header received
0812 21:01:12.551118 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.551120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.551276 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.551373 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:12.551636 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.552837 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.553977 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.554843 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.554947 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.555046 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.555385 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.555443 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":121,"threads_started":1}
I20260812 21:01:12.556138 2952 tablet_service.cc:1514] Processing DeleteTablet for tablet 828dc26d7b2f4eb68c0a621b6163e5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:12 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:47836
I20260812 21:01:12.556773 3084 tablet_replica.cc:330] stopping tablet replica
I20260812 21:01:12.556896 3084 raft_consensus.cc:2229] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:12.556978 3084 raft_consensus.cc:2258] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:12.557353 3084 ts_tablet_manager.cc:1905] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:12.559670 3084 ts_tablet_manager.cc:1918] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:12.559741 3084 log.cc:1196] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/828dc26d7b2f4eb68c0a621b6163e5a6
I20260812 21:01:12.559990 3084 ts_tablet_manager.cc:1939] T 828dc26d7b2f4eb68c0a621b6163e5a6 P 7213f6138b434b558ec3e9bc50c979b6: Deleting consensus metadata
I20260812 21:01:12.560575 2716 catalog_manager.cc:4841] TS 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987): tablet 828dc26d7b2f4eb68c0a621b6163e5a6 (table test-table [id=6133439aa62647a8beee9738e43d1152]) successfully deleted
W20260812 21:01:12.647076 3078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:12.647415 3078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:12.647468 3078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:12.648911 3078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:12.648990 3078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:12.649042 3078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:01:12.650961 3078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:45141
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=33265
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:12.651335 3078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:12.651650 3078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:12.658083 3099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:12.658082 3095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:12.658134 3096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:12.658342 3078 server_base.cc:1034] running on GCE node
I20260812 21:01:12.658665 3078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:12.659116 3078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:12.660298 3078 hybrid_clock.cc:648] HybridClock initialized: now 1786568472660275 us; error 45 us; skew 500 ppm
Aug 12 21:01:12 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568472, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:12.663772 3078 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:01:12.664448 3078 webserver.cc:460] Webserver started at http://127.10.30.66:33265/ using document root <none> and password file <none>
I20260812 21:01:12.664803 3078 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:12.664886 3078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:12.666595 3078 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:12.667411 3111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:12.667666 3078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:12.667783 3078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "44d06915848f49da96e6099217f1bf27"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "e259aa279983d21fa998d3c41d3917f0"
server_key_iv: "7e82ee1bd8e812f7caa69ede710a10cb"
server_key_version: "encryptionkey@0"
I20260812 21:01:12.668287 3078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:12.687950 3078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:12.691413 3078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:12.691681 3078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:12.691992 3078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:12.692440 3078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:12.692477 3078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:12.692508 3078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:12.692574 3078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:12.700987 3078 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:45141
I20260812 21:01:12.701172 3320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:45141 every 8 connection(s)
I20260812 21:01:12.701582 3078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:01:12.701965 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 3078
I20260812 21:01:12.702286 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:42405
--local_ip_for_outbound_sockets=127.10.30.67
--tserver_master_addrs=127.10.30.126:43701
--webserver_port=44761
--webserver_interface=127.10.30.67
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 21:01:12 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568472, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:12.713989 3076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.702763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:49467 (local address 127.10.30.126:43701)
0812 21:01:12.702855 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.702859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.703193 (+ 334us) server_negotiation.cc:407] Connection header received
0812 21:01:12.703909 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.703910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.703927 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.703988 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:12.705233 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.705815 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.706962 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.707262 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.707351 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.710335 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:12.710336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:12.710337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:12.710355 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:12.712209 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:12.712756 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:12.712757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:12.712758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:12.712834 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:12.713156 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:12.713157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:12.713157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:12.713313 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:12.713406 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.713744 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.713869 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 21:01:12.714325 3326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.702743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:49467)
0812 21:01:12.702982 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.703065 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:12.703775 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:12.704094 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:12.704099 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:12.704813 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:12.705104 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.705110 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.705939 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.705940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.706843 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.706845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.707365 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.707366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.707537 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.708367 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:12.708378 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:12.710181 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:12.712324 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:12.712338 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:12.712341 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:12.712662 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:12.712910 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:12.712911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:12.712912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:12.713071 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:12.713395 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:12.713403 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:12.713592 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 21:01:12.713720 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 21:01:12.713944 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":136,"threads_started":1}
I20260812 21:01:12.714977 3322 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43701
I20260812 21:01:12.715142 3322 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:12.715387 3322 heartbeater.cc:511] Master 127.10.30.126:43701 requested a full tablet report, sending...
I20260812 21:01:12.715888 2744 ts_manager.cc:194] Registered new tserver with Master: 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141)
I20260812 21:01:12.716334 2744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:49467
W20260812 21:01:12.803753 3333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:12.804072 3333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:12.804121 3333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:12.805506 3333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:12.805600 3333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:12.805652 3333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:01:12.807490 3333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:42405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=44761
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:12.807857 3333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:12.808158 3333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:12.814349 3347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:12.814374 3343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:12.814370 3341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:12.814844 3333 server_base.cc:1034] running on GCE node
I20260812 21:01:12.815172 3333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:12.815500 3333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:12.816692 3333 hybrid_clock.cc:648] HybridClock initialized: now 1786568472816664 us; error 49 us; skew 500 ppm
Aug 12 21:01:12 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568472, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:12.820019 3333 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:01:12.820604 3333 webserver.cc:460] Webserver started at http://127.10.30.67:44761/ using document root <none> and password file <none>
I20260812 21:01:12.820899 3333 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:12.820999 3333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:12.822659 3333 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 21:01:12.823551 3360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:12.823803 3333 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 21:01:12.823926 3333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "d792fc9524fa403d8536df00748297fd"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "5ad9ca2956a7ddc5d283fafcb1444c86"
server_key_iv: "ab0e1f0b9b0cee1f7d5787506134349f"
server_key_version: "encryptionkey@0"
I20260812 21:01:12.824431 3333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:12.850481 3333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:12.854442 3333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:12.854660 3333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:12.854984 3333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:12.855489 3333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:12.855551 3333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:12.855602 3333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:12.855630 3333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:12.864440 3333 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:42405
I20260812 21:01:12.864517 3564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:42405 every 8 connection(s)
I20260812 21:01:12.865164 3333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:01:12.871209 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 3333
Aug 12 21:01:12 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568472, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:12.878837 3076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.866327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:33425 (local address 127.10.30.126:43701)
0812 21:01:12.866444 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.866446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.866691 (+ 245us) server_negotiation.cc:407] Connection header received
0812 21:01:12.867438 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.867439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.867454 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.867533 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:12.868818 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.869469 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.870671 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.871107 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.871202 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.875127 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:12.875129 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:12.875129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:12.875141 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:12.877078 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:12.877610 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:12.877612 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:12.877612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:12.877681 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:12.877963 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:12.877964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:12.877965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:12.878154 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:12.878232 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.878620 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.878718 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 21:01:12.879240 3569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.866260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:33425)
0812 21:01:12.866489 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.866542 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:12.867307 (+ 765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:12.867631 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:12.867635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:12.868415 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:12.868679 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.868686 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.869594 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.869595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.870549 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.870552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.871257 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.871259 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.871503 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.872419 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:12.872436 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:12.874897 (+ 2461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:12.877166 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:12.877178 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:12.877181 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:12.877531 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:12.877763 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:12.877763 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:12.877764 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:12.877891 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:12.878268 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:12.878277 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:12.878459 (+ 182us) client_negotiation.cc:769] Sending connection context
0812 21:01:12.878593 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 21:01:12.878801 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":121,"threads_started":1}
I20260812 21:01:12.880290 3566 heartbeater.cc:347] Connected to a master server at 127.10.30.126:43701
I20260812 21:01:12.880455 3566 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:12.880746 3566 heartbeater.cc:511] Master 127.10.30.126:43701 requested a full tablet report, sending...
I20260812 21:01:12.881376 2744 ts_manager.cc:194] Registered new tserver with Master: d792fc9524fa403d8536df00748297fd (127.10.30.67:42405)
I20260812 21:01:12.881949 2744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:33425
I20260812 21:01:12.882505 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.871884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57498 (local address 127.10.30.126:43701)
0812 21:01:12.872034 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.872036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.872207 (+ 171us) server_negotiation.cc:407] Connection header received
0812 21:01:12.873311 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.873312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.873328 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.873412 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:12.874387 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.875320 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.876421 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.876669 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.876732 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.878320 (+ 1588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:12.878322 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:12.878322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:12.878329 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:12.880814 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:12.881428 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:12.881430 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:12.881430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:12.881518 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:12.881770 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:12.881771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:12.881771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:12.881922 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:12.882095 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.882291 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.882381 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260812 21:01:12.883405 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:01:12.886682 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.883928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57504 (local address 127.10.30.126:43701)
0812 21:01:12.883999 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.884001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.884075 (+ 74us) server_negotiation.cc:407] Connection header received
0812 21:01:12.884147 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.884147 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.884190 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.884261 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:01:12.884385 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.884880 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.885737 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.885998 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.886066 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.886267 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:01:12.886388 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:01:12.886509 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.886567 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.886599 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 21:01:12.887096 2744 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:57504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:01:12.889241 2744 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:01:12.892397 2952 tablet_service.cc:1467] Processing CreateTablet for tablet 10f2e11407174e1f9bfe337f3571f552 (DEFAULT_TABLE table=test-table [id=da521a67bc1244e3828fb836392fdfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:12.892738 2952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f2e11407174e1f9bfe337f3571f552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:12.894656 2882 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Bootstrap starting.
I20260812 21:01:12.895162 2882 tablet_bootstrap.cc:654] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:12.895921 2882 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: No bootstrap required, opened a new log
I20260812 21:01:12.895983 2882 ts_tablet_manager.cc:1397] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 21:01:12.896132 2882 raft_consensus.cc:348] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:12.896214 2882 raft_consensus.cc:374] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:12.896268 2882 raft_consensus.cc:729] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7213f6138b434b558ec3e9bc50c979b6, State: Initialized, Role: FOLLOWER
I20260812 21:01:12.896314 2882 consensus_queue.cc:260] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:12.896409 2882 ts_tablet_manager.cc:1428] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 21:01:12.896672 3081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.892071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:45141 (local address 127.0.0.1:44172)
0812 21:01:12.892135 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.892149 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:12.892192 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:12.892838 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:12.892840 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:12.892842 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:12.892907 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.892909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.894208 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.894209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.895187 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.895191 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.896380 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.896381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.896456 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.896461 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:01:12.896521 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 21:01:12.896585 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 21:01:12.896692 3581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.892268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44172 (local address 127.10.30.66:45141)
0812 21:01:12.892603 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.892609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.892623 (+ 14us) server_negotiation.cc:407] Connection header received
0812 21:01:12.892679 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.892681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.892700 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.892819 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:12.892988 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.894082 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.895289 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.896155 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.896250 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.896331 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.896543 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.896602 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":129,"threads_started":1}
I20260812 21:01:12.897816 3207 tablet_service.cc:1467] Processing CreateTablet for tablet 10f2e11407174e1f9bfe337f3571f552 (DEFAULT_TABLE table=test-table [id=da521a67bc1244e3828fb836392fdfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:12.898303 3207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f2e11407174e1f9bfe337f3571f552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:12.899127 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.892190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42405 (local address 127.0.0.1:36124)
0812 21:01:12.892304 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:12.892315 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:12.892370 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:12.895244 (+ 2874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:12.895245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:12.895248 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:12.895317 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.895318 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.896700 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.896702 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.897893 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:12.897896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.898815 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.898816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:12.898888 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.898892 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:01:12.898943 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 21:01:12.899045 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":81,"threads_started":1}
I20260812 21:01:12.899195 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:12.892477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36124 (local address 127.10.30.67:42405)
0812 21:01:12.894894 (+ 2417us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:12.894901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:12.894913 (+ 12us) server_negotiation.cc:407] Connection header received
0812 21:01:12.894974 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:12.894976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:12.894996 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:12.895116 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:12.895494 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.896560 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.898009 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:12.898699 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:12.898810 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:12.898973 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:12.899040 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 21:01:12.899094 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2352,"thread_start_us":143,"threads_started":1}
I20260812 21:01:12.900084 3447 tablet_service.cc:1467] Processing CreateTablet for tablet 10f2e11407174e1f9bfe337f3571f552 (DEFAULT_TABLE table=test-table [id=da521a67bc1244e3828fb836392fdfd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:12.900511 3447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f2e11407174e1f9bfe337f3571f552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:12.902833 3587 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Bootstrap starting.
I20260812 21:01:12.903604 3587 tablet_bootstrap.cc:654] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:12.904246 3587 log.cc:824] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:12.904381 3588 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Bootstrap starting.
I20260812 21:01:12.905232 3587 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: No bootstrap required, opened a new log
I20260812 21:01:12.905296 3588 tablet_bootstrap.cc:654] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:12.905328 3587 ts_tablet_manager.cc:1397] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:01:12.906049 3588 log.cc:824] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:12.906981 3588 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: No bootstrap required, opened a new log
I20260812 21:01:12.907100 3588 ts_tablet_manager.cc:1397] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260812 21:01:12.907836 3587 raft_consensus.cc:348] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:12.908049 3587 raft_consensus.cc:374] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:12.908095 3587 raft_consensus.cc:729] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44d06915848f49da96e6099217f1bf27, State: Initialized, Role: FOLLOWER
I20260812 21:01:12.908234 3587 consensus_queue.cc:260] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:12.908599 3587 ts_tablet_manager.cc:1428] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 21:01:12.908628 3322 heartbeater.cc:503] Master 127.10.30.126:43701 was elected leader, sending a full tablet report...
I20260812 21:01:12.909312 3588 raft_consensus.cc:348] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:12.909492 3588 raft_consensus.cc:374] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:12.909533 3588 raft_consensus.cc:729] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d792fc9524fa403d8536df00748297fd, State: Initialized, Role: FOLLOWER
I20260812 21:01:12.909659 3588 consensus_queue.cc:260] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:12.910043 3588 ts_tablet_manager.cc:1428] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 21:01:12.910049 3566 heartbeater.cc:503] Master 127.10.30.126:43701 was elected leader, sending a full tablet report...
W20260812 21:01:12.952512 3323 tablet.cc:2369] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:01:13.040206 3073 tablet.cc:2369] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:01:13.114408 3596 raft_consensus.cc:482] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:13.114605 3596 raft_consensus.cc:504] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:13.115167 3596 leader_election.cc:288] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d792fc9524fa403d8536df00748297fd (127.10.30.67:42405), 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987)
W20260812 21:01:13.116039 3567 tablet.cc:2369] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:01:13.119643 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.115729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:49181 (local address 127.10.30.67:42405)
0812 21:01:13.115804 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:13.115806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:13.116016 (+ 210us) server_negotiation.cc:407] Connection header received
0812 21:01:13.116065 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:13.116066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:13.116080 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:13.116156 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:13.116613 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.117408 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.118600 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.119137 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.119251 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:13.119264 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:13.119493 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 21:01:13.119552 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 21:01:13.119653 3599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.115505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42405 (local address 127.10.30.66:49181)
0812 21:01:13.115874 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.115891 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:13.115995 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:13.116407 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:13.116408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:13.116409 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:13.116503 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:13.116505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.117526 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.117528 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:13.118476 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:13.118479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.119279 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.119281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:13.119382 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:13.119388 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:01:13.119451 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 21:01:13.119507 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":39,"thread_start_us":207,"threads_started":1}
I20260812 21:01:13.119765 3600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.115678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:60519 (local address 127.10.30.65:45987)
0812 21:01:13.115912 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:13.115914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:13.115925 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:01:13.115985 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:13.115986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:13.116004 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:13.116136 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:13.116407 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.117297 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.118489 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.119230 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.119331 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:13.119347 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:13.119593 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 21:01:13.119666 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":106,"threads_started":1}
I20260812 21:01:13.120011 3326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.115490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:45987 (local address 127.10.30.66:60519)
0812 21:01:13.115613 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.115634 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:13.115735 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:13.116186 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:13.116187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:13.116190 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:13.116299 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:13.116301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.117406 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.117407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:13.118352 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:13.118355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.119349 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.119351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:13.119473 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:13.119480 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 21:01:13.119555 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 21:01:13.119623 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":5}
I20260812 21:01:13.120165 3483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f2e11407174e1f9bfe337f3571f552" candidate_uuid: "44d06915848f49da96e6099217f1bf27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d792fc9524fa403d8536df00748297fd" is_pre_election: true
I20260812 21:01:13.120452 3483 raft_consensus.cc:2454] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44d06915848f49da96e6099217f1bf27 in term 0.
I20260812 21:01:13.120473 2991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f2e11407174e1f9bfe337f3571f552" candidate_uuid: "44d06915848f49da96e6099217f1bf27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7213f6138b434b558ec3e9bc50c979b6" is_pre_election: true
I20260812 21:01:13.120689 2991 raft_consensus.cc:2454] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44d06915848f49da96e6099217f1bf27 in term 0.
I20260812 21:01:13.120806 3114 leader_election.cc:302] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44d06915848f49da96e6099217f1bf27, d792fc9524fa403d8536df00748297fd; no voters:
I20260812 21:01:13.121012 3596 raft_consensus.cc:2781] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:01:13.121102 3596 raft_consensus.cc:482] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:01:13.121130 3596 raft_consensus.cc:3037] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:13.122025 3596 raft_consensus.cc:504] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:13.122215 3596 leader_election.cc:288] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [CANDIDATE]: Term 1 election: Requested vote from peers d792fc9524fa403d8536df00748297fd (127.10.30.67:42405), 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987)
I20260812 21:01:13.122416 3483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f2e11407174e1f9bfe337f3571f552" candidate_uuid: "44d06915848f49da96e6099217f1bf27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d792fc9524fa403d8536df00748297fd"
I20260812 21:01:13.122457 2991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f2e11407174e1f9bfe337f3571f552" candidate_uuid: "44d06915848f49da96e6099217f1bf27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7213f6138b434b558ec3e9bc50c979b6"
I20260812 21:01:13.122555 3483 raft_consensus.cc:3037] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:13.122604 2991 raft_consensus.cc:3037] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:13.123597 2991 raft_consensus.cc:2454] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44d06915848f49da96e6099217f1bf27 in term 1.
I20260812 21:01:13.123823 3116 leader_election.cc:302] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44d06915848f49da96e6099217f1bf27, 7213f6138b434b558ec3e9bc50c979b6; no voters:
I20260812 21:01:13.123848 3483 raft_consensus.cc:2454] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44d06915848f49da96e6099217f1bf27 in term 1.
I20260812 21:01:13.123946 3596 raft_consensus.cc:2781] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:13.124161 3596 raft_consensus.cc:686] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 1 LEADER]: Becoming Leader. State: Replica: 44d06915848f49da96e6099217f1bf27, State: Running, Role: LEADER
I20260812 21:01:13.124300 3596 consensus_queue.cc:237] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:13.125416 2744 catalog_manager.cc:5495] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44d06915848f49da96e6099217f1bf27 (127.10.30.66). New cstate: current_term: 1 leader_uuid: "44d06915848f49da96e6099217f1bf27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260812 21:01:13.137029 3581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.133860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44188 (local address 127.10.30.66:45141)
0812 21:01:13.133936 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:13.133938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:13.133949 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:01:13.134028 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:13.134029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:13.134056 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:13.134134 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:01:13.134301 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.134895 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.135997 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:13.136203 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:13.136278 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:13.136522 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:01:13.136653 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:01:13.136758 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:13.136887 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 21:01:13.136912 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 21:01:13.139698 3483 raft_consensus.cc:1261] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 1 FOLLOWER]: Refusing update from remote peer 44d06915848f49da96e6099217f1bf27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:13.139698 2991 raft_consensus.cc:1261] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Refusing update from remote peer 44d06915848f49da96e6099217f1bf27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:13.140223 3603 consensus_queue.cc:1035] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:13.140395 3596 consensus_queue.cc:1035] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:13.143405 3607 mvcc.cc:205] Tried to move back new op lower bound from 7317784465975799808 to 7317784465917767680. Current Snapshot: MvccSnapshot[applied={T|T < 7317784465975799808}]
I20260812 21:01:13.143504 3605 mvcc.cc:205] Tried to move back new op lower bound from 7317784465975799808 to 7317784465917767680. Current Snapshot: MvccSnapshot[applied={T|T < 7317784465975799808}]
I20260812 21:01:13.147389 2744 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:57504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:13.147527 2744 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:57504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:13.148764 2744 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Sending DeleteTablet for 3 replicas of tablet 10f2e11407174e1f9bfe337f3571f552
I20260812 21:01:13.149353 3207 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f2e11407174e1f9bfe337f3571f552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:13 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:44172
I20260812 21:01:13.149353 3447 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f2e11407174e1f9bfe337f3571f552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:13 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:36124
I20260812 21:01:13.149662 3621 tablet_replica.cc:330] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: stopping tablet replica
I20260812 21:01:13.149634 2952 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f2e11407174e1f9bfe337f3571f552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:13 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:47836
I20260812 21:01:13.149804 3621 raft_consensus.cc:2229] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:01:13.149935 3624 tablet_replica.cc:330] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: stopping tablet replica
I20260812 21:01:13.149981 3621 raft_consensus.cc:2258] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:13.150030 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 2818
I20260812 21:01:13.150563 3621 ts_tablet_manager.cc:1905] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:13.153861 3621 ts_tablet_manager.cc:1918] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:13.153970 3621 log.cc:1196] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/10f2e11407174e1f9bfe337f3571f552
I20260812 21:01:13.154374 3621 ts_tablet_manager.cc:1939] T 10f2e11407174e1f9bfe337f3571f552 P 44d06915848f49da96e6099217f1bf27: Deleting consensus metadata
I20260812 21:01:13.161837 2713 catalog_manager.cc:4841] TS 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141): tablet 10f2e11407174e1f9bfe337f3571f552 (table test-table [id=da521a67bc1244e3828fb836392fdfd1]) successfully deleted
I20260812 21:01:13.162146 3622 tablet_replica.cc:330] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: stopping tablet replica
I20260812 21:01:13.162321 3622 raft_consensus.cc:2229] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:13.162474 3622 raft_consensus.cc:2258] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:13.163710 3622 ts_tablet_manager.cc:1905] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:13.165550 3622 ts_tablet_manager.cc:1918] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:13.165680 3622 log.cc:1196] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/10f2e11407174e1f9bfe337f3571f552
I20260812 21:01:13.166116 3622 ts_tablet_manager.cc:1939] T 10f2e11407174e1f9bfe337f3571f552 P d792fc9524fa403d8536df00748297fd: Deleting consensus metadata
I20260812 21:01:13.166689 2713 catalog_manager.cc:4841] TS d792fc9524fa403d8536df00748297fd (127.10.30.67:42405): tablet 10f2e11407174e1f9bfe337f3571f552 (table test-table [id=da521a67bc1244e3828fb836392fdfd1]) successfully deleted
W20260812 21:01:13.170984 2716 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:45987 (error 108)
I20260812 21:01:13.171630 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 3078
I20260812 21:01:13.171881 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.171543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:45987 (local address 127.0.0.1:47848)
0812 21:01:13.171720 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.171805 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260812 21:01:13.183162 2716 catalog_manager.cc:4584] TS 7213f6138b434b558ec3e9bc50c979b6 (127.10.30.65:45987): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10f2e11407174e1f9bfe337f3571f552: Network error: Client connection negotiation failed: client connection to 127.10.30.65:45987: connect: Connection refused (error 111)
I20260812 21:01:13.194550 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 3333
I20260812 21:01:13.217937 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 2678
I20260812 21:01:13.234349 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43701
--webserver_interface=127.10.30.126
--webserver_port=35669
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:43701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:13.334152 3626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:13.334482 3626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:13.334528 3626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:13.335969 3626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:13.336050 3626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:13.336073 3626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:13.336097 3626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:13.336130 3626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:13.337855 3626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:43701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:43701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=35669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:13.338215 3626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:13.338515 3626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:13.344770 3631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:13.344843 3633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:13.344820 3635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:13.345165 3626 server_base.cc:1034] running on GCE node
I20260812 21:01:13.345479 3626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:13.345870 3626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:13.347096 3626 hybrid_clock.cc:648] HybridClock initialized: now 1786568473347070 us; error 58 us; skew 500 ppm
Aug 12 21:01:13 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:13.350623 3626 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:01:13.351363 3626 webserver.cc:460] Webserver started at http://127.10.30.126:35669/ using document root <none> and password file <none>
I20260812 21:01:13.351642 3626 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:13.351698 3626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:13.353510 3626 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:01:13.354409 3648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:13.354745 3626 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:13.354841 3626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "e6f06c982df149c6a194e79dc8a23834"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "b303fa61a4ec008f6c66756783543c2f"
server_key_iv: "26e1a95c4b01e1a02411764a9364e038"
server_key_version: "encryptionkey@0"
I20260812 21:01:13.355396 3626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:13.369135 3626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:13.372278 3626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:13.372493 3626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:13.378618 3626 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:43701
I20260812 21:01:13.378674 3745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:43701 every 8 connection(s)
I20260812 21:01:13.379199 3626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:01:13.381294 3751 sys_catalog.cc:263] Verifying existing consensus state
I20260812 21:01:13.382153 3751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Bootstrap starting.
I20260812 21:01:13.382855 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 3626
I20260812 21:01:13.383261 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:45987
--local_ip_for_outbound_sockets=127.10.30.65
--tserver_master_addrs=127.10.30.126:43701
--webserver_port=37095
--webserver_interface=127.10.30.65
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:13.393446 3751 log.cc:824] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:13.396247 3751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:01:13.396622 3751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834: Bootstrap complete.
I20260812 21:01:13.399716 3751 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:13.400002 3751 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f06c982df149c6a194e79dc8a23834, State: Initialized, Role: FOLLOWER
I20260812 21:01:13.400219 3751 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:13.400321 3751 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:01:13.400422 3751 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:01:13.400470 3751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 2 FOLLOWER]: Advancing to term 3
I20260812 21:01:13.401739 3751 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:13.401852 3751 leader_election.cc:302] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6f06c982df149c6a194e79dc8a23834; no voters:
I20260812 21:01:13.402096 3751 leader_election.cc:288] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 21:01:13.402218 3756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 21:01:13.402462 3751 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:13.402520 3756 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [term 3 LEADER]: Becoming Leader. State: Replica: e6f06c982df149c6a194e79dc8a23834, State: Running, Role: LEADER
I20260812 21:01:13.402683 3756 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } }
I20260812 21:01:13.403162 3759 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e6f06c982df149c6a194e79dc8a23834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } } }
I20260812 21:01:13.403187 3761 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6f06c982df149c6a194e79dc8a23834. Latest consensus state: current_term: 3 leader_uuid: "e6f06c982df149c6a194e79dc8a23834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f06c982df149c6a194e79dc8a23834" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 43701 } } }
I20260812 21:01:13.403272 3759 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:13.403321 3761 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f06c982df149c6a194e79dc8a23834 [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:13.403622 3773 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:01:13.404791 3773 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:01:13.404920 3773 catalog_manager.cc:1259] Loaded cluster ID: 94b846f8456443858827a36b372c4e30
I20260812 21:01:13.404949 3773 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 21:01:13.405356 3773 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f00687db9ad google::LogMessage::Fail() at ??:0
@ 0x7f00687de88a google::LogMessage::SendToLog() at ??:0
@ 0x7f00687db4de google::LogMessage::Flush() at ??:0
@ 0x7f00687dca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f00706fc0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f00707058b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f006a6a90d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f006a69e954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f006b5026db start_thread at ??:0
@ 0x7f00672d961f clone at ??:0
W20260812 21:01:13.503881 3753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:13.504179 3753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:13.504212 3753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:13.505649 3753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:13.505713 3753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:13.505746 3753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:01:13.507634 3753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:45987
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=37095
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:13.507962 3753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:13.508299 3753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:13.514634 3809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:13.514640 3812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:13.515194 3753 server_base.cc:1034] running on GCE node
W20260812 21:01:13.514640 3810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:13.515503 3753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:13.515864 3753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:13.517083 3753 hybrid_clock.cc:648] HybridClock initialized: now 1786568473517057 us; error 46 us; skew 500 ppm
Aug 12 21:01:13 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:13.520561 3753 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:01:13.521389 3753 webserver.cc:460] Webserver started at http://127.10.30.65:37095/ using document root <none> and password file <none>
I20260812 21:01:13.521754 3753 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:13.521847 3753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:13.523808 3753 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 21:01:13.524897 3826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:13.525218 3753 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:01:13.525333 3753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "7213f6138b434b558ec3e9bc50c979b6"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "c519a05685fc6eaf8eedd531587dbed6"
server_key_iv: "fe13a78f9ac34e08d0eadccbb95b98e1"
server_key_version: "encryptionkey@0"
I20260812 21:01:13.525841 3753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:13.543535 3753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:13.546464 3753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:13.546679 3753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:13.547097 3753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:13.547724 3841 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 21:01:13.549993 3753 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 21:01:13.550089 3753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260812 21:01:13.550187 3753 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 21:01:13.551230 3753 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 21:01:13.551294 3753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260812 21:01:13.551496 3841 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Bootstrap starting.
I20260812 21:01:13.560784 3753 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:45987
I20260812 21:01:13.561036 4027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:45987 every 8 connection(s)
I20260812 21:01:13.561350 3753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:01:13.561810 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 3753
I20260812 21:01:13.562191 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:45141
--local_ip_for_outbound_sockets=127.10.30.66
--tserver_master_addrs=127.10.30.126:43701
--webserver_port=33265
--webserver_interface=127.10.30.66
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:13.565495 3841 log.cc:824] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:13.569382 3841 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:01:13.569764 3841 tablet_bootstrap.cc:492] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Bootstrap complete.
I20260812 21:01:13.571380 3841 ts_tablet_manager.cc:1397] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.013s
I20260812 21:01:13.573478 3841 raft_consensus.cc:348] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:13.573925 3841 raft_consensus.cc:729] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7213f6138b434b558ec3e9bc50c979b6, State: Initialized, Role: FOLLOWER
I20260812 21:01:13.574146 3841 consensus_queue.cc:260] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:13.574544 3841 ts_tablet_manager.cc:1428] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
W20260812 21:01:13.636826 4038 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:01:13.566433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:55677)
0812 21:01:13.566795 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.566848 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:13.567684 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:13.636514 (+ 68830us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":125,"threads_started":1}
W20260812 21:01:13.637135 4029 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:43701 (0 consecutive failures): Network error: Failed to ping master at 127.10.30.126:43701: Client connection negotiation failed: client connection to 127.10.30.126:43701: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 21:01:13.637669 4038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.637441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:60719)
0812 21:01:13.637534 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.637620 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 21:01:13.638417 4038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.638313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:39221)
0812 21:01:13.638369 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.638398 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 21:01:13.638602 4029 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 21:01:13.663422 4034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:13.663686 4034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:13.663717 4034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:13.664929 4034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:13.664974 4034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:13.665001 4034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:01:13.666586 4034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:45141
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=33265
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:13.666826 4034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:13.667174 4034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:13.674216 4050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:13.674228 4048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:13.674253 4034 server_base.cc:1034] running on GCE node
W20260812 21:01:13.674238 4047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:13.674757 4034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:13.675124 4034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:13.676313 4034 hybrid_clock.cc:648] HybridClock initialized: now 1786568473676297 us; error 57 us; skew 500 ppm
Aug 12 21:01:13 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:13.679404 4034 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:01:13.680006 4034 webserver.cc:460] Webserver started at http://127.10.30.66:33265/ using document root <none> and password file <none>
I20260812 21:01:13.680280 4034 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:13.680357 4034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:13.682015 4034 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 21:01:13.682890 4062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:13.683200 4034 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:13.683321 4034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "44d06915848f49da96e6099217f1bf27"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "e259aa279983d21fa998d3c41d3917f0"
server_key_iv: "7e82ee1bd8e812f7caa69ede710a10cb"
server_key_version: "encryptionkey@0"
I20260812 21:01:13.683830 4034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:13.699234 4034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:13.701896 4034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:13.702118 4034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:13.702430 4034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:13.702826 4034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:13.702885 4034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:13.702930 4034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:13.702960 4034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:13.711654 4034 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:45141
I20260812 21:01:13.711714 4260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:45141 every 8 connection(s)
I20260812 21:01:13.712178 4034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:01:13.713637 4264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.713090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:36425)
0812 21:01:13.713303 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.713432 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":84,"threads_started":1}
W20260812 21:01:13.714273 4262 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:43701 (0 consecutive failures): Network error: Failed to ping master at 127.10.30.126:43701: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
I20260812 21:01:13.714696 4264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.714563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:60803)
0812 21:01:13.714637 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.714674 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 21:01:13.715111 4264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.714981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:42431)
0812 21:01:13.715063 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.715094 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 21:01:13.715256 4262 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 21:01:13.721444 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 4034
I20260812 21:01:13.721908 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:42405
--local_ip_for_outbound_sockets=127.10.30.67
--tserver_master_addrs=127.10.30.126:43701
--webserver_port=44761
--webserver_interface=127.10.30.67
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:13.822811 4265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:13.823133 4265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:13.823163 4265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:13.824409 4265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:13.824448 4265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:13.824477 4265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:01:13.826108 4265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:42405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=44761
--tserver_master_addrs=127.10.30.126:43701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:13.826375 4265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:13.826610 4265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:13.833308 4277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:13.833307 4279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:13.833307 4276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:13.833518 4265 server_base.cc:1034] running on GCE node
I20260812 21:01:13.834038 4265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:13.834443 4265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:13.835609 4265 hybrid_clock.cc:648] HybridClock initialized: now 1786568473835566 us; error 65 us; skew 500 ppm
Aug 12 21:01:13 dist-test-slave-h3ft krb5kdc[1687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:13.839287 4265 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:01:13.839916 4265 webserver.cc:460] Webserver started at http://127.10.30.67:44761/ using document root <none> and password file <none>
I20260812 21:01:13.840269 4265 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:13.840358 4265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:13.842309 4265 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:01:13.843341 4295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:13.843587 4265 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:13.843770 4265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "d792fc9524fa403d8536df00748297fd"
format_stamp: "Formatted at 2026-08-12 21:01:11 on dist-test-slave-h3ft"
server_key: "5ad9ca2956a7ddc5d283fafcb1444c86"
server_key_iv: "ab0e1f0b9b0cee1f7d5787506134349f"
server_key_version: "encryptionkey@0"
I20260812 21:01:13.844226 4265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:13.874286 4265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:13.876946 4265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:13.877133 4265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:13.877418 4265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:13.877791 4265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:13.877852 4265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:13.877893 4265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:13.877944 4265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:13.885625 4265 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:42405
I20260812 21:01:13.885656 4499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:42405 every 8 connection(s)
I20260812 21:01:13.886116 4265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:01:13.887794 4503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.887124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:55453)
0812 21:01:13.887398 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.887543 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":109,"threads_started":1}
W20260812 21:01:13.888409 4501 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:43701 (0 consecutive failures): Network error: Failed to ping master at 127.10.30.126:43701: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
I20260812 21:01:13.888867 4503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.888722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:40833)
0812 21:01:13.888791 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.888837 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 21:01:13.889292 4503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:13.889134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:59169)
0812 21:01:13.889224 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:13.889265 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260812 21:01:13.889532 4501 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 21:01:13.890295 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 4265
I20260812 21:01:14.639671 4505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:14.639311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:54923)
0812 21:01:14.639490 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:14.639576 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":82,"threads_started":1}
I20260812 21:01:14.716045 4507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:14.715696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:58137)
0812 21:01:14.715859 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:14.715911 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
I20260812 21:01:14.890342 4508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:14.889995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:53771)
0812 21:01:14.890216 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:14.890272 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":89,"threads_started":1}
I20260812 21:01:14.900331 4511 raft_consensus.cc:482] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:14.900516 4511 raft_consensus.cc:504] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:14.901017 4511 leader_election.cc:288] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141), d792fc9524fa403d8536df00748297fd (127.10.30.67:42405)
Aug 12 21:01:14 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.67@KRBTEST.COM
Aug 12 21:01:14 dist-test-slave-h3ft krb5kdc[1687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.66@KRBTEST.COM
I20260812 21:01:14.918495 4516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:14.901581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:58115 (local address 127.10.30.67:42405)
0812 21:01:14.901787 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:14.901799 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:14.901839 (+ 40us) server_negotiation.cc:407] Connection header received
0812 21:01:14.902404 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:14.902407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:14.902466 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:14.902660 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:14.903795 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:14.904729 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:14.906205 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:14.906841 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:14.906993 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:14.914307 (+ 7314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:14.914314 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:14.914315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:14.914332 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:14.916466 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:14.917031 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:14.917034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:14.917034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:14.917139 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:14.917423 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:14.917424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:14.917424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:14.917748 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:14.917854 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:14.918187 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 21:01:14.918352 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260812 21:01:14.918493 4513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:14.901451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:42405 (local address 127.10.30.65:58115)
0812 21:01:14.901620 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:14.901634 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:14.901682 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:14.902689 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:14.902691 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:14.903273 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:14.903530 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:14.903540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:14.904856 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:14.904857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:14.905875 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:14.905880 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:14.906981 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:14.906983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:14.907153 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:14.911699 (+ 4546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:14.911706 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:14.914117 (+ 2411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:14.916581 (+ 2464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:14.916593 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:14.916597 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:14.916886 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:14.917228 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:14.917229 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:14.917229 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:14.917351 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:14.917841 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:14.917850 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:14.918001 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 21:01:14.918116 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 21:01:14.918354 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":121,"thread_start_us":105,"threads_started":1}
I20260812 21:01:14.918926 4505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:14.901251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:45141 (local address 127.10.30.65:35479)
0812 21:01:14.901346 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:14.901367 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:14.901491 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:14.902651 (+ 1160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:14.902655 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:14.903262 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:14.903528 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:14.903537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:14.904904 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:14.904905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:14.905760 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:14.905762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:14.906596 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:14.906598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:14.906750 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:14.911611 (+ 4861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:14.911625 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:14.914479 (+ 2854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:14.917075 (+ 2596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:14.917077 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:14.917077 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:14.917297 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:14.917622 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:14.917624 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:14.917624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:14.917715 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:14.918196 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:14.918197 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:14.918306 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 21:01:14.918396 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 21:01:14.918549 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":53}
I20260812 21:01:14.919480 4512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:14.901414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:35479 (local address 127.10.30.66:45141)
0812 21:01:14.901691 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:14.901708 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:14.901762 (+ 54us) server_negotiation.cc:407] Connection header received
0812 21:01:14.902360 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:14.902364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:14.902419 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:14.902564 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:14.903677 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:14.904762 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:14.905884 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:14.906461 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:14.906568 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:14.914666 (+ 8098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:14.914674 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:14.914674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:14.914697 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:14.916946 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:14.917410 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:14.917414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:14.917414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:14.917529 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:14.917792 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:14.917794 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:14.917794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:14.918101 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:14.918221 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:14.918475 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 21:01:14.919395 (+ 920us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":104,"threads_started":1}
W20260812 21:01:14.919734 3827 leader_election.cc:341] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d792fc9524fa403d8536df00748297fd (127.10.30.67:42405): Not found: Tablet not found: 10f2e11407174e1f9bfe337f3571f552
W20260812 21:01:14.920390 3827 leader_election.cc:341] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141): Not found: Tablet not found: 10f2e11407174e1f9bfe337f3571f552
I20260812 21:01:14.920462 3827 leader_election.cc:302] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7213f6138b434b558ec3e9bc50c979b6; no voters: 44d06915848f49da96e6099217f1bf27, d792fc9524fa403d8536df00748297fd
I20260812 21:01:14.920637 4511 raft_consensus.cc:2726] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:01:15.640790 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:15.640456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:48873)
0812 21:01:15.640653 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:15.640732 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":93,"threads_started":1}
I20260812 21:01:15.717100 4522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:15.716737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:55797)
0812 21:01:15.716953 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:15.717020 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":82,"threads_started":1}
I20260812 21:01:15.891530 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:15.891187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:33077)
0812 21:01:15.891397 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:15.891464 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":92,"threads_started":1}
I20260812 21:01:16.641796 4526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:16.641442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:50419)
0812 21:01:16.641673 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:16.641740 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":99,"threads_started":1}
I20260812 21:01:16.718206 4527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:16.717838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:39801)
0812 21:01:16.718062 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:16.718134 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":87,"threads_started":1}
I20260812 21:01:16.718380 4528 raft_consensus.cc:482] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:16.718516 4528 raft_consensus.cc:504] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:16.718716 4528 leader_election.cc:288] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141), d792fc9524fa403d8536df00748297fd (127.10.30.67:42405)
W20260812 21:01:16.719358 3827 leader_election.cc:341] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141): Not found: Tablet not found: 10f2e11407174e1f9bfe337f3571f552
W20260812 21:01:16.719424 3827 leader_election.cc:341] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d792fc9524fa403d8536df00748297fd (127.10.30.67:42405): Not found: Tablet not found: 10f2e11407174e1f9bfe337f3571f552
I20260812 21:01:16.719447 3827 leader_election.cc:302] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7213f6138b434b558ec3e9bc50c979b6; no voters: 44d06915848f49da96e6099217f1bf27, d792fc9524fa403d8536df00748297fd
I20260812 21:01:16.719520 4528 raft_consensus.cc:2726] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:01:16.892668 4530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:16.892346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:51099)
0812 21:01:16.892553 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:16.892609 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":145,"threads_started":1}
I20260812 21:01:17.642773 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:17.642458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:49189)
0812 21:01:17.642661 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:17.642712 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":97,"threads_started":1}
I20260812 21:01:17.719336 4532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:17.718907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:43665)
0812 21:01:17.719176 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:17.719252 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":81,"threads_started":1}
I20260812 21:01:17.893832 4534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:17.893464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:47341)
0812 21:01:17.893683 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:17.893758 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":92,"threads_started":1}
I20260812 21:01:18.643915 4541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:18.643574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:35729)
0812 21:01:18.643773 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:18.643841 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":84,"threads_started":1}
I20260812 21:01:18.720446 4542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:18.720130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:42959)
0812 21:01:18.720302 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:18.720363 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
I20260812 21:01:18.895177 4543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:18.894688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:43495)
0812 21:01:18.894931 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:18.895092 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":85,"threads_started":1}
I20260812 21:01:19.487471 4548 raft_consensus.cc:482] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:19.487601 4548 raft_consensus.cc:504] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:19.487856 4548 leader_election.cc:288] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141), d792fc9524fa403d8536df00748297fd (127.10.30.67:42405)
W20260812 21:01:19.488338 3827 leader_election.cc:341] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d792fc9524fa403d8536df00748297fd (127.10.30.67:42405): Not found: Tablet not found: 10f2e11407174e1f9bfe337f3571f552
W20260812 21:01:19.488421 3827 leader_election.cc:341] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141): Not found: Tablet not found: 10f2e11407174e1f9bfe337f3571f552
I20260812 21:01:19.488440 3827 leader_election.cc:302] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7213f6138b434b558ec3e9bc50c979b6; no voters: 44d06915848f49da96e6099217f1bf27, d792fc9524fa403d8536df00748297fd
I20260812 21:01:19.488533 4548 raft_consensus.cc:2726] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:01:19.645330 4549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:19.644883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:57083)
0812 21:01:19.645158 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:19.645244 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":110,"threads_started":1}
I20260812 21:01:19.721669 4550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:19.721266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:42377)
0812 21:01:19.721522 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:19.721595 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":112,"threads_started":1}
I20260812 21:01:19.896368 4552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:19.895968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:55751)
0812 21:01:19.896220 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:19.896308 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":100,"threads_started":1}
I20260812 21:01:20.646433 4553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:20.646110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:48265)
0812 21:01:20.646321 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:20.646366 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":133,"threads_started":1}
I20260812 21:01:20.722786 4554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:20.722441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:53539)
0812 21:01:20.722662 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:20.722714 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":140,"threads_started":1}
I20260812 21:01:20.897509 4555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:20.897107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:39325)
0812 21:01:20.897363 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:20.897444 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":100,"threads_started":1}
I20260812 21:01:21.647454 4556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:21.647092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:48723)
0812 21:01:21.647306 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:21.647379 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
I20260812 21:01:21.723738 4557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:21.723399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:57371)
0812 21:01:21.723603 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:21.723663 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":84,"threads_started":1}
I20260812 21:01:21.898568 4559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:21.898220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:36657)
0812 21:01:21.898440 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:21.898501 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":105,"threads_started":1}
I20260812 21:01:22.344467 4562 raft_consensus.cc:482] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:22.344635 4562 raft_consensus.cc:504] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d06915848f49da96e6099217f1bf27" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45141 } } peers { permanent_uuid: "d792fc9524fa403d8536df00748297fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 42405 } } peers { permanent_uuid: "7213f6138b434b558ec3e9bc50c979b6" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 45987 } }
I20260812 21:01:22.344951 4562 leader_election.cc:288] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141), d792fc9524fa403d8536df00748297fd (127.10.30.67:42405)
W20260812 21:01:22.345517 3827 leader_election.cc:341] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d792fc9524fa403d8536df00748297fd (127.10.30.67:42405): Not found: Tablet not found: 10f2e11407174e1f9bfe337f3571f552
W20260812 21:01:22.345656 3827 leader_election.cc:341] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44d06915848f49da96e6099217f1bf27 (127.10.30.66:45141): Not found: Tablet not found: 10f2e11407174e1f9bfe337f3571f552
I20260812 21:01:22.345779 3827 leader_election.cc:302] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7213f6138b434b558ec3e9bc50c979b6; no voters: 44d06915848f49da96e6099217f1bf27, d792fc9524fa403d8536df00748297fd
I20260812 21:01:22.345916 4562 raft_consensus.cc:2726] T 10f2e11407174e1f9bfe337f3571f552 P 7213f6138b434b558ec3e9bc50c979b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:01:22.648419 4563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:22.648105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:43167)
0812 21:01:22.648294 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:22.648360 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":92,"threads_started":1}
I20260812 21:01:22.724820 4564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:22.724503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:38583)
0812 21:01:22.724693 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:22.724747 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":81,"threads_started":1}
I20260812 21:01:22.899765 4565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:22.899441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:40261)
0812 21:01:22.899636 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:22.899689 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":127,"threads_started":1}
I20260812 21:01:23.649474 4567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:23.649150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:49665)
0812 21:01:23.649352 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:23.649418 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":98,"threads_started":1}
I20260812 21:01:23.725905 4568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:23.725567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:44447)
0812 21:01:23.725767 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:23.725835 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":85,"threads_started":1}
I20260812 21:01:23.900933 4569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:23.900583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:43853)
0812 21:01:23.900804 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:23.900873 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":106,"threads_started":1}
I20260812 21:01:24.650563 4570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:24.650226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:59973)
0812 21:01:24.650439 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:24.650502 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":94,"threads_started":1}
I20260812 21:01:24.727082 4572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:24.726649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:55955)
0812 21:01:24.726854 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:24.726928 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":99,"threads_started":1}
I20260812 21:01:24.902062 4573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:24.901705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:38709)
0812 21:01:24.901930 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:24.902001 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":103,"threads_started":1}
I20260812 21:01:25.651827 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:25.651443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:36177)
0812 21:01:25.651698 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:25.651768 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":91,"threads_started":1}
I20260812 21:01:25.728230 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:25.727843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:54345)
0812 21:01:25.728080 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:25.728154 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":93,"threads_started":1}
I20260812 21:01:25.903293 4579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:25.902806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:37645)
0812 21:01:25.903143 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:25.903220 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":86,"threads_started":1}
I20260812 21:01:26.653055 4580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:26.652723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:36831)
0812 21:01:26.652915 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:26.652961 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":123,"threads_started":1}
I20260812 21:01:26.729197 4581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:26.728876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:53009)
0812 21:01:26.729071 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:26.729141 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":113,"threads_started":1}
I20260812 21:01:26.904495 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:26.904119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:43593)
0812 21:01:26.904351 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:26.904419 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":114,"threads_started":1}
I20260812 21:01:27.653877 4583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:27.653543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:48963)
0812 21:01:27.653756 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:27.653807 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":88,"threads_started":1}
I20260812 21:01:27.730245 4584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:27.729874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:53689)
0812 21:01:27.730121 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:27.730190 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":146,"threads_started":1}
I20260812 21:01:27.905862 4587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:27.905421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:55239)
0812 21:01:27.905712 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:27.905804 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":148,"threads_started":1}
I20260812 21:01:28.654806 4591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:28.654572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.65:43273)
0812 21:01:28.654721 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:28.654754 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260812 21:01:28.731498 4593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:28.731146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.66:51779)
0812 21:01:28.731380 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:28.731441 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":125,"threads_started":1}
I20260812 21:01:28.900017 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 3753
I20260812 21:01:28.933537 4594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:28.914398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:43701 (local address 127.10.30.67:46513)
0812 21:01:28.933354 (+ 18956us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:28.933450 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:43701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18914,"thread_start_us":84,"threads_started":1}
I20260812 21:01:28.939692 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 4034
I20260812 21:01:28.963300 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 4265
2026-08-12T21:01:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19357 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:01:29 dist-test-slave-h3ft krb5kdc[4599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:01:29 dist-test-slave-h3ft krb5kdc[4599](info): set up 2 sockets
Aug 12 21:01:29 dist-test-slave-h3ft krb5kdc[4599](info): commencing operation
krb5kdc: starting...
W20260812 21:01:30.361795 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.359s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:01:30 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:01:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:01:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:01:30.510751 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41655
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:41655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:30.607057 4622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:30.607383 4622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:30.607424 4622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:30.608726 4622 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 21:01:30.608807 4622 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 21:01:30.608829 4622 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 21:01:30.608848 4622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:30.608891 4622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:30.608919 4622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:30.608948 4622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:30.608978 4622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:30.610703 4622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:41655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:30.611135 4622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:30.611430 4622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:30.617565 4639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:30.617568 4631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:30.617609 4622 server_base.cc:1034] running on GCE node
W20260812 21:01:30.617578 4632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:30.618214 4622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:30.618593 4622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:30.619817 4622 hybrid_clock.cc:648] HybridClock initialized: now 1786568490619809 us; error 41 us; skew 500 ppm
Aug 12 21:01:30 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568490, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:30.623349 4622 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:01:30.623999 4622 webserver.cc:460] Webserver started at http://127.10.30.126:46541/ using document root <none> and password file <none>
I20260812 21:01:30.624267 4622 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:30.624317 4622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:30.624485 4622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:30.625810 4622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "ac6325813fabec54592c4ad1495b4708"
server_key_iv: "99add7454eed9cac0f99b66d382b2728"
server_key_version: "encryptionkey@0"
I20260812 21:01:30.626179 4622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "ac6325813fabec54592c4ad1495b4708"
server_key_iv: "99add7454eed9cac0f99b66d382b2728"
server_key_version: "encryptionkey@0"
I20260812 21:01:30.627895 4622 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 21:01:30.628829 4647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:30.629192 4622 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:30.629292 4622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "ac6325813fabec54592c4ad1495b4708"
server_key_iv: "99add7454eed9cac0f99b66d382b2728"
server_key_version: "encryptionkey@0"
I20260812 21:01:30.629424 4622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:30.647902 4622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:30.650674 4622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:30.650872 4622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:30.656116 4622 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:41655
I20260812 21:01:30.656224 4731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:41655 every 8 connection(s)
I20260812 21:01:30.656663 4622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:01:30.657773 4735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:30.658509 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 4622
I20260812 21:01:30.658645 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:01:30.658885 10361 external_mini_cluster.cc:1428] Setting key 86490fab1581c67e730660fb63716d22
I20260812 21:01:30.661305 4735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Bootstrap starting.
I20260812 21:01:30.662073 4735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:30.662411 4735 log.cc:824] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:30.663329 4735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: No bootstrap required, opened a new log
I20260812 21:01:30.666224 4735 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:01:30.666424 4735 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:30.666451 4735 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdc1b8bf3114d7fb9591f970e49d0dd, State: Initialized, Role: FOLLOWER
I20260812 21:01:30.666606 4735 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:01:30.666688 4735 raft_consensus.cc:388] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:01:30.666733 4735 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:01:30.666790 4735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 0 FOLLOWER]: Advancing to term 1
Aug 12 21:01:30 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:30.667554 4735 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:01:30.667689 4735 leader_election.cc:302] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdc1b8bf3114d7fb9591f970e49d0dd; no voters:
I20260812 21:01:30.667927 4735 leader_election.cc:288] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:01:30.667963 4745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:30.668123 4745 raft_consensus.cc:686] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 1 LEADER]: Becoming Leader. State: Replica: ecdc1b8bf3114d7fb9591f970e49d0dd, State: Running, Role: LEADER
I20260812 21:01:30.668212 4745 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:01:30.668290 4735 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:30.668570 4745 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecdc1b8bf3114d7fb9591f970e49d0dd. Latest consensus state: current_term: 1 leader_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } } }
I20260812 21:01:30.668733 4745 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:30.668758 4747 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } } }
I20260812 21:01:30.668890 4747 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: This master's current role is: LEADER
W20260812 21:01:30.670480 4768 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:01:30.670567 4768 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:01:30.670636 4754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:01:30.670828 4754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:01:30.671960 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:30.659597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59376 (local address 127.10.30.126:41655)
0812 21:01:30.659788 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:30.659805 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:30.659835 (+ 30us) server_negotiation.cc:407] Connection header received
0812 21:01:30.660283 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:30.660290 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:30.660341 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:30.660473 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:30.661498 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:30.662581 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:30.663691 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:30.664138 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:30.664247 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:30.667719 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:30.667725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:30.667725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:30.667741 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:30.670058 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:30.670460 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:30.670464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:30.670465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:30.670638 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:30.670885 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:30.670886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:30.670886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:30.671232 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:30.671448 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:30.671527 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 21:01:30.671680 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260812 21:01:30.672842 4754 catalog_manager.cc:1347] Generated new cluster ID: 54ae799c6d79423b93fbf4afd8d5a744
I20260812 21:01:30.672886 4754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:01:30.684589 4754 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:01:30.685225 4754 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:01:30.693526 4754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Generated new TSK 0
I20260812 21:01:30.694060 4754 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 21:01:30.755750 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41655
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:30.883839 4779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:30.884111 4779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:30.884138 4779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:30.885490 4779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:30.885538 4779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:30.885566 4779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:01:30.887339 4779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:30.887620 4779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:30.887966 4779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:30.893896 4787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:30.893947 4786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:30.893998 4793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:30.894220 4779 server_base.cc:1034] running on GCE node
I20260812 21:01:30.894452 4779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:30.894790 4779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:30.895977 4779 hybrid_clock.cc:648] HybridClock initialized: now 1786568490895965 us; error 48 us; skew 500 ppm
Aug 12 21:01:30 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568490, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:30.899360 4779 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:01:30.899936 4779 webserver.cc:460] Webserver started at http://127.10.30.65:45673/ using document root <none> and password file <none>
I20260812 21:01:30.900228 4779 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:30.900309 4779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:30.900522 4779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:30.901899 4779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "746d5032ddee45e4bb6d663690e0f449"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "1e8313ba3be5811f2bd1ae093bf8328c"
server_key_iv: "64ab3b391346e423ea87d80deb197915"
server_key_version: "encryptionkey@0"
I20260812 21:01:30.902359 4779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "746d5032ddee45e4bb6d663690e0f449"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "1e8313ba3be5811f2bd1ae093bf8328c"
server_key_iv: "64ab3b391346e423ea87d80deb197915"
server_key_version: "encryptionkey@0"
I20260812 21:01:30.904160 4779 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:01:30.905298 4811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:30.905560 4779 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:30.905689 4779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "746d5032ddee45e4bb6d663690e0f449"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "1e8313ba3be5811f2bd1ae093bf8328c"
server_key_iv: "64ab3b391346e423ea87d80deb197915"
server_key_version: "encryptionkey@0"
I20260812 21:01:30.905779 4779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:30.919746 4779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:30.922211 4779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:30.922379 4779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:30.922607 4779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:30.922991 4779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:30.923089 4779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:30.923133 4779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:30.923162 4779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:30.930608 4779 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:35747
I20260812 21:01:30.930702 5003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:35747 every 8 connection(s)
I20260812 21:01:30.931143 4779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:01:30.935612 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 4779
I20260812 21:01:30.935738 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:01:30.936024 10361 external_mini_cluster.cc:1428] Setting key 34a9399011cfab3501fb842311d218a6
Aug 12 21:01:30 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568490, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:30.942672 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:30.932166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:39383 (local address 127.10.30.126:41655)
0812 21:01:30.932257 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:30.932259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:30.932442 (+ 183us) server_negotiation.cc:407] Connection header received
0812 21:01:30.933167 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:30.933169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:30.933183 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:30.933247 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:30.934434 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:30.935115 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:30.936386 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:30.936635 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:30.936731 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:30.939418 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:30.939421 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:30.939421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:30.939430 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:30.941008 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:30.941524 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:30.941525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:30.941525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:30.941599 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:30.941882 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:30.941883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:30.941883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:30.942029 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:30.942109 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:30.942441 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 21:01:30.942564 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 21:01:30.942898 5008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:30.932010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:39383)
0812 21:01:30.932290 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:30.932341 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:30.933035 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:30.933335 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:30.933339 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:30.934069 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:30.934315 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:30.934320 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:30.935219 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:30.935221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:30.936288 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:30.936290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:30.936745 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:30.936746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:30.936911 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:30.937610 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:30.937620 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:30.939300 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:30.941122 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:30.941131 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:30.941134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:30.941427 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:30.941674 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:30.941674 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:30.941675 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:30.941805 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:30.942108 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:30.942117 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:30.942290 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 21:01:30.942407 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 21:01:30.942608 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":139,"threads_started":1}
I20260812 21:01:30.943573 5006 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41655
I20260812 21:01:30.943746 5006 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:30.944007 5006 heartbeater.cc:511] Master 127.10.30.126:41655 requested a full tablet report, sending...
I20260812 21:01:30.944773 4672 ts_manager.cc:194] Registered new tserver with Master: 746d5032ddee45e4bb6d663690e0f449 (127.10.30.65:35747)
I20260812 21:01:30.945868 4672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:39383
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 21:01:30.972707 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41655
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:31.076154 5012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:31.076450 5012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:31.076483 5012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:31.078374 5012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:31.078470 5012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:31.078531 5012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:01:31.080582 5012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:31.080929 5012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:31.081257 5012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:31.087615 5021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:31.087708 5022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:31.087783 5012 server_base.cc:1034] running on GCE node
W20260812 21:01:31.087947 5024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:31.088465 5012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:31.088843 5012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:31.090039 5012 hybrid_clock.cc:648] HybridClock initialized: now 1786568491089998 us; error 58 us; skew 500 ppm
Aug 12 21:01:31 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568491, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:31.094102 5012 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:01:31.094906 5012 webserver.cc:460] Webserver started at http://127.10.30.66:44637/ using document root <none> and password file <none>
I20260812 21:01:31.095310 5012 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:31.095424 5012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:31.095602 5012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:31.097296 5012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "f12324b931aa4af4920455616e2512ca"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "dfc560990d1e542d53aaddb881ee2d27"
server_key_iv: "a6ebc916e854dd2e548ae3c98c39ff0e"
server_key_version: "encryptionkey@0"
I20260812 21:01:31.097769 5012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "f12324b931aa4af4920455616e2512ca"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "dfc560990d1e542d53aaddb881ee2d27"
server_key_iv: "a6ebc916e854dd2e548ae3c98c39ff0e"
server_key_version: "encryptionkey@0"
I20260812 21:01:31.099789 5012 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 21:01:31.100893 5039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:31.101218 5012 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:31.101352 5012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "f12324b931aa4af4920455616e2512ca"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "dfc560990d1e542d53aaddb881ee2d27"
server_key_iv: "a6ebc916e854dd2e548ae3c98c39ff0e"
server_key_version: "encryptionkey@0"
I20260812 21:01:31.101444 5012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:31.118449 5012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:31.121912 5012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:31.122138 5012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:31.122499 5012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:31.122969 5012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:31.123078 5012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:31.123121 5012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:31.123134 5012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:31.131421 5012 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:33351
I20260812 21:01:31.131599 5245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:33351 every 8 connection(s)
I20260812 21:01:31.131968 5012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
Aug 12 21:01:31 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568491, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:31.141140 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 5012
I20260812 21:01:31.141309 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:01:31.141556 10361 external_mini_cluster.cc:1428] Setting key f5ef4ab327347e077980f792abc4070d
I20260812 21:01:31.144394 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.133112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:35961 (local address 127.10.30.126:41655)
0812 21:01:31.133222 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.133225 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.133446 (+ 221us) server_negotiation.cc:407] Connection header received
0812 21:01:31.134239 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.134240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.134256 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.134306 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:31.135670 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.136244 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.137506 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.137722 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.137784 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.140672 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:31.140674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:31.140675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:31.140683 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:31.142636 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:31.143209 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:31.143211 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:31.143212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:31.143289 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:31.143599 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:31.143600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:31.143600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:31.143744 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:31.143822 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.144171 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.144275 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 21:01:31.144650 5249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.133070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:35961)
0812 21:01:31.133300 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.133345 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:31.134101 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:31.134408 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:31.134412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:31.135228 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:31.135475 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.135480 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.136358 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.136359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.137400 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.137404 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.137821 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.137823 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.137989 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.138694 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:31.138704 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:31.140561 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:31.142739 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:31.142749 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:31.142753 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:31.143124 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:31.143378 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:31.143379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:31.143379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:31.143521 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:31.143823 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:31.143833 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:31.144014 (+ 181us) client_negotiation.cc:769] Sending connection context
0812 21:01:31.144130 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 21:01:31.144342 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":111,"threads_started":1}
I20260812 21:01:31.145184 5246 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41655
I20260812 21:01:31.145304 5246 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:31.145560 5246 heartbeater.cc:511] Master 127.10.30.126:41655 requested a full tablet report, sending...
I20260812 21:01:31.146044 4672 ts_manager.cc:194] Registered new tserver with Master: f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
I20260812 21:01:31.146494 4672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:35961
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 21:01:31.179865 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41655
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:31.278635 5252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:31.278959 5252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:31.279006 5252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:31.280380 5252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:31.280464 5252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:31.280512 5252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:01:31.282196 5252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:31.282537 5252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:31.282827 5252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:31.289165 5260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:31.289156 5259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:31.289125 5262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:31.289742 5252 server_base.cc:1034] running on GCE node
I20260812 21:01:31.290014 5252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:31.290341 5252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:31.291496 5252 hybrid_clock.cc:648] HybridClock initialized: now 1786568491291482 us; error 34 us; skew 500 ppm
Aug 12 21:01:31 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568491, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:31.294636 5252 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:01:31.295243 5252 webserver.cc:460] Webserver started at http://127.10.30.67:32839/ using document root <none> and password file <none>
I20260812 21:01:31.295500 5252 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:31.295569 5252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:31.295744 5252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:01:31.297066 5252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "0994d084f91649728f1ed29f613408fd"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "0802a5978399a79cbdebd25758fc7a67"
server_key_iv: "4e26e80c90064cb5d400ab8c6155e3e0"
server_key_version: "encryptionkey@0"
I20260812 21:01:31.297497 5252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "0994d084f91649728f1ed29f613408fd"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "0802a5978399a79cbdebd25758fc7a67"
server_key_iv: "4e26e80c90064cb5d400ab8c6155e3e0"
server_key_version: "encryptionkey@0"
I20260812 21:01:31.299245 5252 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:01:31.300189 5276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:31.300397 5252 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:31.300515 5252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "0994d084f91649728f1ed29f613408fd"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "0802a5978399a79cbdebd25758fc7a67"
server_key_iv: "4e26e80c90064cb5d400ab8c6155e3e0"
server_key_version: "encryptionkey@0"
I20260812 21:01:31.300601 5252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:31.317796 5252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:31.320466 5252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:31.320659 5252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:31.320991 5252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:31.321368 5252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:31.321424 5252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:31.321463 5252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:31.321506 5252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:31.329025 5252 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:33327
I20260812 21:01:31.329177 5466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:33327 every 8 connection(s)
I20260812 21:01:31.329536 5252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
Aug 12 21:01:31 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568491, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:31.338665 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 5252
I20260812 21:01:31.338824 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:01:31.339180 10361 external_mini_cluster.cc:1428] Setting key 22288fbda9b38db697c1f87d72d6504d
I20260812 21:01:31.341924 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.330562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:56711 (local address 127.10.30.126:41655)
0812 21:01:31.330653 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.330656 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.330978 (+ 322us) server_negotiation.cc:407] Connection header received
0812 21:01:31.331618 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.331619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.331634 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.331701 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:31.332870 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.333623 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.334725 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.334928 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.334988 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.337985 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:31.337987 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:31.337987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:31.337996 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:31.340084 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:31.340623 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:31.340625 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:31.340625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:31.340706 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:31.341114 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:31.341115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:31.341116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:31.341291 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:31.341367 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.341752 (+ 385us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.341844 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 21:01:31.342216 5470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.330532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:56711)
0812 21:01:31.330734 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.330783 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:31.331489 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:31.331766 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:31.331770 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:31.332501 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:31.332754 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.332759 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.333735 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.333736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.334640 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.334642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.335107 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.335108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.335230 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.335846 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:31.335855 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:31.337814 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:31.340173 (+ 2359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:31.340183 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:31.340187 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:31.340531 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:31.340810 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:31.340811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:31.340812 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:31.341000 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:31.341372 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:31.341381 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:31.341580 (+ 199us) client_negotiation.cc:769] Sending connection context
0812 21:01:31.341695 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 21:01:31.341867 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":103,"threads_started":1}
I20260812 21:01:31.342779 5467 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41655
I20260812 21:01:31.342916 5467 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:31.343197 5467 heartbeater.cc:511] Master 127.10.30.126:41655 requested a full tablet report, sending...
I20260812 21:01:31.343705 4672 ts_manager.cc:194] Registered new tserver with Master: 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327)
I20260812 21:01:31.344103 4672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:56711
I20260812 21:01:31.351568 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:01:31.360263 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.353318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59392 (local address 127.10.30.126:41655)
0812 21:01:31.353391 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.353394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.353534 (+ 140us) server_negotiation.cc:407] Connection header received
0812 21:01:31.353620 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.353621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.353633 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.353703 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:31.354408 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.354951 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.355786 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.355991 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.356093 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.357570 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:31.357572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:31.357572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:31.357580 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:31.358908 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:31.359324 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:31.359326 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:31.359327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:31.359388 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:31.359606 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:31.359607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:31.359607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:31.359787 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:31.359911 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.360042 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.360139 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 21:01:31.362115 4672 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:01:31.364388 4672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:01:31.372871 5491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.368119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39178 (local address 127.10.30.66:33351)
0812 21:01:31.368368 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.368375 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.368877 (+ 502us) server_negotiation.cc:407] Connection header received
0812 21:01:31.368943 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.368946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.368965 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.369134 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:31.369295 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.370385 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.371642 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.372385 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.372470 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.372539 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.372726 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.372775 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":137,"threads_started":1}
I20260812 21:01:31.372860 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.367793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:33351 (local address 127.0.0.1:39178)
0812 21:01:31.368760 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.368771 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:31.368833 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:31.369145 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:31.369146 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:31.369149 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:31.369199 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.369202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.370509 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.370510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.371547 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.371550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.372473 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.372474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.372589 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.372611 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 21:01:31.372692 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 21:01:31.372759 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"mutex_wait_us":102,"thread_start_us":118,"threads_started":1}
I20260812 21:01:31.373366 5485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.367527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:33327 (local address 127.0.0.1:33584)
0812 21:01:31.368000 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.368012 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:31.368085 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:31.369307 (+ 1222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:31.369308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:31.369310 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:31.369356 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.369357 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.370514 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.370515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.371834 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.371836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.372856 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.372857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.372925 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.372929 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:01:31.373234 (+ 305us) client_negotiation.cc:240] Negotiation successful
0812 21:01:31.373284 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":73,"thread_start_us":71,"threads_started":1}
I20260812 21:01:31.373720 5490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.367704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33584 (local address 127.10.30.67:33327)
0812 21:01:31.368976 (+ 1272us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.368980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.368988 (+ 8us) server_negotiation.cc:407] Connection header received
0812 21:01:31.369083 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.369086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.369104 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.369192 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:31.369452 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.370387 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.371938 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.372753 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.372851 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.372910 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.373567 (+ 657us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.373627 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1230,"thread_start_us":212,"threads_started":1}
I20260812 21:01:31.373907 5127 tablet_service.cc:1467] Processing CreateTablet for tablet 67493f584b62495ebbaae205d35e20d7 (DEFAULT_TABLE table=test-table [id=e9058c57009c451185d91b8dabc78b8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:31.374414 5127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67493f584b62495ebbaae205d35e20d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:31.374511 5486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.367718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57400 (local address 127.10.30.65:35747)
0812 21:01:31.368461 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.368465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.368474 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:01:31.368517 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.368519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.368533 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.368631 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:31.368893 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.370283 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.372967 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.373765 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.374116 (+ 351us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.374192 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.374361 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.374414 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":121,"threads_started":1}
I20260812 21:01:31.374497 5348 tablet_service.cc:1467] Processing CreateTablet for tablet 67493f584b62495ebbaae205d35e20d7 (DEFAULT_TABLE table=test-table [id=e9058c57009c451185d91b8dabc78b8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:31.374788 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.367527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35747 (local address 127.0.0.1:57400)
0812 21:01:31.367770 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.367818 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:31.367958 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:31.368649 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:31.368654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:31.368657 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:31.368743 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.368745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.370406 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.370407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.371832 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.371836 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.374184 (+ 2348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.374185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.374251 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.374257 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:01:31.374325 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 21:01:31.374373 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":51,"thread_start_us":113,"threads_started":1}
I20260812 21:01:31.374919 5348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67493f584b62495ebbaae205d35e20d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:31.378000 5499 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Bootstrap starting.
I20260812 21:01:31.378659 4881 tablet_service.cc:1467] Processing CreateTablet for tablet 67493f584b62495ebbaae205d35e20d7 (DEFAULT_TABLE table=test-table [id=e9058c57009c451185d91b8dabc78b8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:31.378852 5499 tablet_bootstrap.cc:654] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:31.379108 4881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67493f584b62495ebbaae205d35e20d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:31.379635 5499 log.cc:824] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:31.380092 5500 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Bootstrap starting.
I20260812 21:01:31.380539 5499 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: No bootstrap required, opened a new log
I20260812 21:01:31.380637 5499 ts_tablet_manager.cc:1397] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 21:01:31.380923 5500 tablet_bootstrap.cc:654] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:31.381610 5500 log.cc:824] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:31.382534 5500 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: No bootstrap required, opened a new log
I20260812 21:01:31.382622 5500 ts_tablet_manager.cc:1397] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:01:31.382619 5499 raft_consensus.cc:348] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.382830 5499 raft_consensus.cc:374] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:31.382879 5499 raft_consensus.cc:729] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f12324b931aa4af4920455616e2512ca, State: Initialized, Role: FOLLOWER
I20260812 21:01:31.383073 5499 consensus_queue.cc:260] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.383435 5499 ts_tablet_manager.cc:1428] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 21:01:31.383599 5246 heartbeater.cc:503] Master 127.10.30.126:41655 was elected leader, sending a full tablet report...
I20260812 21:01:31.383801 5510 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Bootstrap starting.
I20260812 21:01:31.384549 5510 tablet_bootstrap.cc:654] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:31.385164 5510 log.cc:824] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:31.385143 5500 raft_consensus.cc:348] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.385339 5500 raft_consensus.cc:374] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:31.385397 5500 raft_consensus.cc:729] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0994d084f91649728f1ed29f613408fd, State: Initialized, Role: FOLLOWER
I20260812 21:01:31.385531 5500 consensus_queue.cc:260] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.385879 5500 ts_tablet_manager.cc:1428] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 21:01:31.385915 5467 heartbeater.cc:503] Master 127.10.30.126:41655 was elected leader, sending a full tablet report...
I20260812 21:01:31.386072 5510 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: No bootstrap required, opened a new log
I20260812 21:01:31.386165 5510 ts_tablet_manager.cc:1397] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 21:01:31.387925 5510 raft_consensus.cc:348] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.388067 5510 raft_consensus.cc:374] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:31.388091 5510 raft_consensus.cc:729] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746d5032ddee45e4bb6d663690e0f449, State: Initialized, Role: FOLLOWER
I20260812 21:01:31.388206 5510 consensus_queue.cc:260] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.388460 5510 ts_tablet_manager.cc:1428] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 21:01:31.388540 5006 heartbeater.cc:503] Master 127.10.30.126:41655 was elected leader, sending a full tablet report...
W20260812 21:01:31.432092 5007 tablet.cc:2369] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:01:31.580376 5469 tablet.cc:2369] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:01:31.633045 5248 tablet.cc:2369] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:01:31.663295 5513 raft_consensus.cc:482] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:31.663524 5513 raft_consensus.cc:504] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.664057 5513 leader_election.cc:288] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
I20260812 21:01:31.668035 5490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.664550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:52671 (local address 127.10.30.67:33327)
0812 21:01:31.664681 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.664684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.664750 (+ 66us) server_negotiation.cc:407] Connection header received
0812 21:01:31.664910 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.664911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.664931 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.665004 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:31.665490 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.666012 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.667147 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.667580 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.667677 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.667691 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.667889 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.667941 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 21:01:31.668030 5491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.664752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:56607 (local address 127.10.30.66:33351)
0812 21:01:31.664853 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.664856 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.664866 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:01:31.664935 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.664936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.664948 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.665030 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:31.665456 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.666052 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.667178 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.667580 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.667694 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.667705 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.667891 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.667933 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 21:01:31.668085 5515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.664579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:33351 (local address 127.10.30.65:56607)
0812 21:01:31.664761 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.664774 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:31.664864 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:31.665051 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:31.665052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:31.665054 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:31.665358 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.665360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.666156 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.666158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.667083 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.667085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.667719 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.667720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.667798 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.667805 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 21:01:31.667872 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 21:01:31.667924 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":20,"thread_start_us":82,"threads_started":1}
I20260812 21:01:31.668094 5514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.664338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:33327 (local address 127.10.30.65:52671)
0812 21:01:31.664656 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.664673 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:31.664766 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:31.665009 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:31.665010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:31.665013 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:31.665345 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.665350 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.666108 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.666110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.667035 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:31.667037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.667716 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.667717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:31.667798 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.667805 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 21:01:31.667881 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 21:01:31.667928 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":29,"thread_start_us":108,"threads_started":1}
I20260812 21:01:31.668927 5378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67493f584b62495ebbaae205d35e20d7" candidate_uuid: "746d5032ddee45e4bb6d663690e0f449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0994d084f91649728f1ed29f613408fd" is_pre_election: true
I20260812 21:01:31.668921 5164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67493f584b62495ebbaae205d35e20d7" candidate_uuid: "746d5032ddee45e4bb6d663690e0f449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f12324b931aa4af4920455616e2512ca" is_pre_election: true
I20260812 21:01:31.669164 5378 raft_consensus.cc:2454] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746d5032ddee45e4bb6d663690e0f449 in term 0.
I20260812 21:01:31.669164 5164 raft_consensus.cc:2454] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746d5032ddee45e4bb6d663690e0f449 in term 0.
I20260812 21:01:31.669483 4813 leader_election.cc:302] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0994d084f91649728f1ed29f613408fd, 746d5032ddee45e4bb6d663690e0f449; no voters:
I20260812 21:01:31.669636 5513 raft_consensus.cc:2781] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:01:31.669730 5513 raft_consensus.cc:482] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:01:31.669768 5513 raft_consensus.cc:3037] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:31.670913 5513 raft_consensus.cc:504] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.671131 5513 leader_election.cc:288] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 1 election: Requested vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
I20260812 21:01:31.671407 5164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67493f584b62495ebbaae205d35e20d7" candidate_uuid: "746d5032ddee45e4bb6d663690e0f449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f12324b931aa4af4920455616e2512ca"
I20260812 21:01:31.671401 5378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67493f584b62495ebbaae205d35e20d7" candidate_uuid: "746d5032ddee45e4bb6d663690e0f449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0994d084f91649728f1ed29f613408fd"
I20260812 21:01:31.671519 5164 raft_consensus.cc:3037] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:31.671543 5378 raft_consensus.cc:3037] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:31.672770 5378 raft_consensus.cc:2454] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746d5032ddee45e4bb6d663690e0f449 in term 1.
I20260812 21:01:31.672770 5164 raft_consensus.cc:2454] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746d5032ddee45e4bb6d663690e0f449 in term 1.
I20260812 21:01:31.673080 4813 leader_election.cc:302] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0994d084f91649728f1ed29f613408fd, 746d5032ddee45e4bb6d663690e0f449; no voters:
I20260812 21:01:31.673202 5513 raft_consensus.cc:2781] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:31.673427 5513 raft_consensus.cc:686] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 LEADER]: Becoming Leader. State: Replica: 746d5032ddee45e4bb6d663690e0f449, State: Running, Role: LEADER
I20260812 21:01:31.673606 5513 consensus_queue.cc:237] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:31.674777 4672 catalog_manager.cc:5495] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 746d5032ddee45e4bb6d663690e0f449 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "746d5032ddee45e4bb6d663690e0f449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } health_report { overall_health: HEALTHY } } }
I20260812 21:01:31.728137 5486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.725211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57414 (local address 127.10.30.65:35747)
0812 21:01:31.725279 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:31.725286 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:31.725296 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:01:31.725347 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:31.725348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:31.725376 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:31.725447 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:01:31.725615 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.726177 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.727145 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:31.727357 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:31.727418 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:31.727613 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:01:31.727747 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:01:31.727820 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:31.727959 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 21:01:31.727982 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 21:01:31.730609 5164 raft_consensus.cc:1261] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 1 FOLLOWER]: Refusing update from remote peer 746d5032ddee45e4bb6d663690e0f449: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:31.730667 5378 raft_consensus.cc:1261] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 1 FOLLOWER]: Refusing update from remote peer 746d5032ddee45e4bb6d663690e0f449: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:31.731226 5516 consensus_queue.cc:1035] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:31.731457 5513 consensus_queue.cc:1035] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:31.735195 5519 mvcc.cc:205] Tried to move back new op lower bound from 7317784542124830720 to 7317784541895958528. Current Snapshot: MvccSnapshot[applied={T|T < 7317784542124830720}]
I20260812 21:01:31.735338 5522 mvcc.cc:205] Tried to move back new op lower bound from 7317784542124830720 to 7317784541895958528. Current Snapshot: MvccSnapshot[applied={T|T < 7317784542124830720}]
I20260812 21:01:31.735702 5520 mvcc.cc:205] Tried to move back new op lower bound from 7317784542124830720 to 7317784541895958528. Current Snapshot: MvccSnapshot[applied={T|T < 7317784542124830720}]
I20260812 21:01:31.738863 4670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:31.739029 4670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:31.740070 4670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Sending DeleteTablet for 3 replicas of tablet 67493f584b62495ebbaae205d35e20d7
I20260812 21:01:31.740453 4881 tablet_service.cc:1514] Processing DeleteTablet for tablet 67493f584b62495ebbaae205d35e20d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:31 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:57400
I20260812 21:01:31.740489 5348 tablet_service.cc:1514] Processing DeleteTablet for tablet 67493f584b62495ebbaae205d35e20d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:31 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:33584
I20260812 21:01:31.740557 5127 tablet_service.cc:1514] Processing DeleteTablet for tablet 67493f584b62495ebbaae205d35e20d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:31 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:39178
I20260812 21:01:31.740736 5531 tablet_replica.cc:330] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: stopping tablet replica
I20260812 21:01:31.740845 5531 raft_consensus.cc:2229] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:01:31.740865 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 4779
I20260812 21:01:31.740996 5531 raft_consensus.cc:2258] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:31.766597 5534 tablet_replica.cc:330] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: stopping tablet replica
I20260812 21:01:31.766819 5534 raft_consensus.cc:2229] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:31.766971 5534 raft_consensus.cc:2258] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:31.769730 5533 tablet_replica.cc:330] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: stopping tablet replica
I20260812 21:01:31.769927 5533 raft_consensus.cc:2229] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:31.770089 5533 raft_consensus.cc:2258] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:31.770835 5533 ts_tablet_manager.cc:1905] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:31.770880 5534 ts_tablet_manager.cc:1905] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:31.773296 5533 ts_tablet_manager.cc:1918] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:31.773335 5534 ts_tablet_manager.cc:1918] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:31.773455 5534 log.cc:1196] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/67493f584b62495ebbaae205d35e20d7
I20260812 21:01:31.773459 5533 log.cc:1196] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/67493f584b62495ebbaae205d35e20d7
I20260812 21:01:31.773798 5534 ts_tablet_manager.cc:1939] T 67493f584b62495ebbaae205d35e20d7 P f12324b931aa4af4920455616e2512ca: Deleting consensus metadata
I20260812 21:01:31.773955 5533 ts_tablet_manager.cc:1939] T 67493f584b62495ebbaae205d35e20d7 P 0994d084f91649728f1ed29f613408fd: Deleting consensus metadata
I20260812 21:01:31.774456 4649 catalog_manager.cc:4841] TS f12324b931aa4af4920455616e2512ca (127.10.30.66:33351): tablet 67493f584b62495ebbaae205d35e20d7 (table test-table [id=e9058c57009c451185d91b8dabc78b8f]) successfully deleted
W20260812 21:01:31.774603 4650 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:35747 (error 108)
I20260812 21:01:31.774857 4649 catalog_manager.cc:4841] TS 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327): tablet 67493f584b62495ebbaae205d35e20d7 (table test-table [id=e9058c57009c451185d91b8dabc78b8f]) successfully deleted
I20260812 21:01:31.775395 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.775187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35747 (local address 127.0.0.1:57426)
0812 21:01:31.775262 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.775318 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 21:01:31.775480 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 5012
W20260812 21:01:31.775617 4650 catalog_manager.cc:4584] TS 746d5032ddee45e4bb6d663690e0f449 (127.10.30.65:35747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 67493f584b62495ebbaae205d35e20d7: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35747: connect: Connection refused (error 111)
I20260812 21:01:31.796365 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 5252
I20260812 21:01:31.837642 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.837412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35747 (local address 127.0.0.1:57440)
0812 21:01:31.837516 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.837577 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 21:01:31.838213 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:31.838041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35747 (local address 127.0.0.1:57446)
0812 21:01:31.838122 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:31.838163 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 21:01:31.843729 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 4622
I20260812 21:01:51.861570 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41655
--webserver_interface=127.10.30.126
--webserver_port=46541
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:41655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:01:51.964004 5541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:51.964324 5541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:51.964354 5541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:51.965786 5541 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 21:01:51.965842 5541 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 21:01:51.965857 5541 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 21:01:51.965868 5541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:01:51.965883 5541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:51.965896 5541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:51.965909 5541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:01:51.965921 5541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:01:51.967813 5541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:41655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=46541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:51.968169 5541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:51.968523 5541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:51.981484 5553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:51.981503 5552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:51.981822 5541 server_base.cc:1034] running on GCE node
W20260812 21:01:51.981483 5555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:51.982493 5541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:51.982942 5541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:51.984220 5541 hybrid_clock.cc:648] HybridClock initialized: now 1786568511984199 us; error 41 us; skew 500 ppm
Aug 12 21:01:51 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568511, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:51.987995 5541 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:01:51.988701 5541 webserver.cc:460] Webserver started at http://127.10.30.126:46541/ using document root <none> and password file <none>
I20260812 21:01:51.989038 5541 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:51.989159 5541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:51.991305 5541 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:01:51.992276 5565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:51.992504 5541 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:51.992662 5541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "ac6325813fabec54592c4ad1495b4708"
server_key_iv: "99add7454eed9cac0f99b66d382b2728"
server_key_version: "encryptionkey@0"
I20260812 21:01:51.993237 5541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:52.001458 5541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:52.004817 5541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:52.005084 5541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:52.011296 5541 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:41655
I20260812 21:01:52.011350 5651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:41655 every 8 connection(s)
I20260812 21:01:52.011890 5541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:01:52.013927 5653 sys_catalog.cc:263] Verifying existing consensus state
I20260812 21:01:52.014715 5653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Bootstrap starting.
I20260812 21:01:52.021281 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 5541
I20260812 21:01:52.021698 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:35747
--local_ip_for_outbound_sockets=127.10.30.65
--tserver_master_addrs=127.10.30.126:41655
--webserver_port=45673
--webserver_interface=127.10.30.65
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:52.028036 5653 log.cc:824] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:52.030522 5653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:01:52.030969 5653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Bootstrap complete.
I20260812 21:01:52.033870 5653 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:01:52.034160 5653 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdc1b8bf3114d7fb9591f970e49d0dd, State: Initialized, Role: FOLLOWER
I20260812 21:01:52.034365 5653 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:01:52.034447 5653 raft_consensus.cc:388] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:01:52.034531 5653 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:01:52.034595 5653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260812 21:01:52.036129 5653 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:01:52.036298 5653 leader_election.cc:302] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdc1b8bf3114d7fb9591f970e49d0dd; no voters:
I20260812 21:01:52.036602 5653 leader_election.cc:288] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 21:01:52.036659 5658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260812 21:01:52.036829 5658 raft_consensus.cc:686] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 2 LEADER]: Becoming Leader. State: Replica: ecdc1b8bf3114d7fb9591f970e49d0dd, State: Running, Role: LEADER
I20260812 21:01:52.036936 5658 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:01:52.036978 5653 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:01:52.037263 5661 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } } }
I20260812 21:01:52.037362 5661 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:52.037830 5662 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecdc1b8bf3114d7fb9591f970e49d0dd. Latest consensus state: current_term: 2 leader_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } } }
I20260812 21:01:52.037951 5665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:01:52.037967 5662 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: This master's current role is: LEADER
I20260812 21:01:52.039098 5665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:01:52.039232 5665 catalog_manager.cc:1259] Loaded cluster ID: 54ae799c6d79423b93fbf4afd8d5a744
I20260812 21:01:52.039274 5665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:01:52.040498 5665 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:01:52.040710 5665 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Loaded TSK: 0
I20260812 21:01:52.052127 5665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Generated new TSK 1
I20260812 21:01:52.052284 5665 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 21:01:52.132325 5655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:52.132688 5655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:52.132738 5655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:52.134572 5655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:52.134716 5655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:52.134780 5655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:01:52.137534 5655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:35747
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=45673
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:52.137967 5655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:52.138319 5655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:52.145802 5699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:52.145808 5695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:52.145805 5694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:52.146620 5655 server_base.cc:1034] running on GCE node
I20260812 21:01:52.146962 5655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:52.147374 5655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:52.148562 5655 hybrid_clock.cc:648] HybridClock initialized: now 1786568512148536 us; error 47 us; skew 500 ppm
Aug 12 21:01:52 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:52.152294 5655 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:01:52.152995 5655 webserver.cc:460] Webserver started at http://127.10.30.65:45673/ using document root <none> and password file <none>
I20260812 21:01:52.153296 5655 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:52.153404 5655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:52.155710 5655 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:01:52.156735 5709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:52.157122 5655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:52.157289 5655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "746d5032ddee45e4bb6d663690e0f449"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "1e8313ba3be5811f2bd1ae093bf8328c"
server_key_iv: "64ab3b391346e423ea87d80deb197915"
server_key_version: "encryptionkey@0"
I20260812 21:01:52.157811 5655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:52.186255 5655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:52.189616 5655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:52.189862 5655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:52.190205 5655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:52.190869 5717 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 21:01:52.193008 5655 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 21:01:52.193082 5655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 21:01:52.193117 5655 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 21:01:52.194027 5655 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 21:01:52.194083 5655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 21:01:52.194136 5717 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Bootstrap starting.
I20260812 21:01:52.205555 5655 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:35747
I20260812 21:01:52.206314 5655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:01:52.207327 5902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:35747 every 8 connection(s)
I20260812 21:01:52.211274 5717 log.cc:824] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:52.211364 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 5655
I20260812 21:01:52.211901 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:33351
--local_ip_for_outbound_sockets=127.10.30.66
--tserver_master_addrs=127.10.30.126:41655
--webserver_port=44637
--webserver_interface=127.10.30.66
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:01:52.218760 5717 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:01:52.219228 5717 tablet_bootstrap.cc:492] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Bootstrap complete.
I20260812 21:01:52.221491 5717 ts_tablet_manager.cc:1397] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.013s
Aug 12 21:01:52 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:52.223501 5717 raft_consensus.cc:348] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.223979 5717 raft_consensus.cc:729] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746d5032ddee45e4bb6d663690e0f449, State: Initialized, Role: FOLLOWER
I20260812 21:01:52.224188 5717 consensus_queue.cc:260] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.224609 5717 ts_tablet_manager.cc:1428] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260812 21:01:52.227319 5909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.212785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:36329 (local address 127.10.30.126:41655)
0812 21:01:52.214536 (+ 1751us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.214548 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.214603 (+ 55us) server_negotiation.cc:407] Connection header received
0812 21:01:52.214780 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.214787 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.214858 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.215058 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:52.216035 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.217507 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.219121 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.219785 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.219913 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.222994 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:52.223024 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:52.223024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:52.223042 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:52.225212 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.225723 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.225727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.225728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.225854 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.226137 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.226138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.226139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.226434 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:52.226545 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.226884 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.227078 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1682,"thread_start_us":111,"threads_started":1}
I20260812 21:01:52.227319 5908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.212299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:36329)
0812 21:01:52.213253 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.213314 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:52.214260 (+ 946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:52.215220 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:52.215228 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:52.215560 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:52.215869 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.215879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.217668 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.217669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.218992 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.218996 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.219950 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.219952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.220126 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.220882 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:52.220893 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:52.222845 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:52.225339 (+ 2494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:52.225347 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:52.225349 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:52.225623 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:52.225931 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:52.225932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:52.225933 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:52.226064 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:52.226530 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:52.226537 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:52.226694 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 21:01:52.226809 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 21:01:52.227078 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"thread_start_us":122,"threads_started":1}
I20260812 21:01:52.228245 5903 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41655
I20260812 21:01:52.228390 5903 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:52.228641 5903 heartbeater.cc:511] Master 127.10.30.126:41655 requested a full tablet report, sending...
I20260812 21:01:52.229720 5594 ts_manager.cc:194] Registered new tserver with Master: 746d5032ddee45e4bb6d663690e0f449 (127.10.30.65:35747)
I20260812 21:01:52.231176 5594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:36329
I20260812 21:01:52.232282 5903 heartbeater.cc:503] Master 127.10.30.126:41655 was elected leader, sending a full tablet report...
Aug 12 21:01:52 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568511, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.65@KRBTEST.COM
I20260812 21:01:52.242255 5912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.230595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35747 (local address 127.0.0.1:43926)
0812 21:01:52.231306 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.231360 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:52.231508 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:52.231880 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:52.231888 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:52.232362 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:52.232455 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.232459 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.233558 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.233560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.234596 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.234599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.235207 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.235208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.235307 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.236053 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:52.236060 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:52.238405 (+ 2345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:52.240724 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:52.240738 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:52.240741 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:52.241016 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:52.241288 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:52.241289 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:52.241290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:52.241369 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:52.241736 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:52.241746 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:52.241818 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 21:01:52.241931 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 21:01:52.242116 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":141,"threads_started":1}
I20260812 21:01:52.242252 5913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.230662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43926 (local address 127.10.30.65:35747)
0812 21:01:52.231201 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.231207 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.231493 (+ 286us) server_negotiation.cc:407] Connection header received
0812 21:01:52.231676 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.231679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.231712 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.231789 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:52.232620 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.233457 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.234716 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.235122 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.235195 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.238527 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:52.238545 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:52.238545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:52.238557 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:52.240585 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.241118 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.241122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.241122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.241204 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.241440 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.241441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.241441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.241649 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:52.241751 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.241975 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.242113 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":104,"threads_started":1}
I20260812 21:01:52.242884 5793 tablet_service.cc:1514] Processing DeleteTablet for tablet 67493f584b62495ebbaae205d35e20d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:31 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:43926
I20260812 21:01:52.243681 5915 tablet_replica.cc:330] stopping tablet replica
I20260812 21:01:52.243829 5915 raft_consensus.cc:2229] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:52.243948 5915 raft_consensus.cc:2258] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:52.244381 5915 ts_tablet_manager.cc:1905] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:52.247237 5915 ts_tablet_manager.cc:1918] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:52.247329 5915 log.cc:1196] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal/wals/67493f584b62495ebbaae205d35e20d7
I20260812 21:01:52.247740 5915 ts_tablet_manager.cc:1939] T 67493f584b62495ebbaae205d35e20d7 P 746d5032ddee45e4bb6d663690e0f449: Deleting consensus metadata
I20260812 21:01:52.248492 5569 catalog_manager.cc:4841] TS 746d5032ddee45e4bb6d663690e0f449 (127.10.30.65:35747): tablet 67493f584b62495ebbaae205d35e20d7 (table test-table [id=e9058c57009c451185d91b8dabc78b8f]) successfully deleted
W20260812 21:01:52.328953 5910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:52.329291 5910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:52.329340 5910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:52.330823 5910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:52.330947 5910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:52.331001 5910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:01:52.332903 5910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:33351
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=44637
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:52.333261 5910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:52.333575 5910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:01:52.341840 5922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:52.341845 5925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:52.341840 5923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:52.344038 5910 server_base.cc:1034] running on GCE node
I20260812 21:01:52.344398 5910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:52.344806 5910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:52.349102 5910 hybrid_clock.cc:648] HybridClock initialized: now 1786568512349043 us; error 55 us; skew 500 ppm
Aug 12 21:01:52 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:52.353950 5910 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:01:52.354740 5910 webserver.cc:460] Webserver started at http://127.10.30.66:44637/ using document root <none> and password file <none>
I20260812 21:01:52.355203 5910 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:52.355286 5910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:52.357126 5910 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:01:52.358048 5937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:52.358342 5910 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:52.358506 5910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "f12324b931aa4af4920455616e2512ca"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "dfc560990d1e542d53aaddb881ee2d27"
server_key_iv: "a6ebc916e854dd2e548ae3c98c39ff0e"
server_key_version: "encryptionkey@0"
I20260812 21:01:52.358986 5910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:52.394909 5910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:52.398047 5910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:52.398221 5910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:52.398532 5910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:52.398885 5910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:52.398918 5910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:52.398947 5910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:52.398959 5910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:52.407848 5910 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:33351
I20260812 21:01:52.408038 6129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:33351 every 8 connection(s)
I20260812 21:01:52.408488 5910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:01:52.410413 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 5910
I20260812 21:01:52.410987 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:33327
--local_ip_for_outbound_sockets=127.10.30.67
--tserver_master_addrs=127.10.30.126:41655
--webserver_port=32839
--webserver_interface=127.10.30.67
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 21:01:52 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:52.423425 5909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.409714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:41939 (local address 127.10.30.126:41655)
0812 21:01:52.409800 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.409802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.410061 (+ 259us) server_negotiation.cc:407] Connection header received
0812 21:01:52.410745 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.410748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.410770 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.410830 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:52.412515 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.413211 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.415410 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.415673 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.415747 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.419386 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:52.419390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:52.419390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:52.419402 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:52.421491 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.422129 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.422131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.422131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.422203 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.422523 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.422524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.422524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.422675 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:52.422758 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.423181 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.423308 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 21:01:52.423683 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.409638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:41939)
0812 21:01:52.409854 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.409908 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:52.410615 (+ 707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:52.410936 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:52.410941 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:52.412052 (+ 1111us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:52.412367 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.412375 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.413386 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.413387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.415205 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.415211 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.415793 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.415794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.415994 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.416722 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:52.416736 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:52.419220 (+ 2484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:52.421628 (+ 2408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:52.421644 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:52.421647 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:52.422014 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:52.422289 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:52.422290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:52.422290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:52.422441 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:52.422758 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:52.422768 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:52.422962 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 21:01:52.423143 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 21:01:52.423365 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":120,"threads_started":1}
I20260812 21:01:52.424448 6130 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41655
I20260812 21:01:52.424609 6130 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:52.424908 6130 heartbeater.cc:511] Master 127.10.30.126:41655 requested a full tablet report, sending...
I20260812 21:01:52.425612 5594 ts_manager.cc:194] Registered new tserver with Master: f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
I20260812 21:01:52.426476 5594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:41939
W20260812 21:01:52.525440 6137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:01:52.525714 6137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:01:52.525745 6137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:01:52.527098 6137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:01:52.527138 6137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:01:52.527165 6137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:01:52.528759 6137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:33327
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=32839
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:01:52.529099 6137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:01:52.529371 6137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 21:01:52.535821 6137 server_base.cc:1034] running on GCE node
W20260812 21:01:52.535794 6146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:52.535776 6150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:01:52.535781 6148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:01:52.536439 6137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:01:52.536767 6137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:01:52.537981 6137 hybrid_clock.cc:648] HybridClock initialized: now 1786568512537954 us; error 48 us; skew 500 ppm
Aug 12 21:01:52 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:01:52.541651 6137 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:01:52.542223 6137 webserver.cc:460] Webserver started at http://127.10.30.67:32839/ using document root <none> and password file <none>
I20260812 21:01:52.542554 6137 fs_manager.cc:359] Metadata directory not provided
I20260812 21:01:52.542654 6137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:01:52.544297 6137 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:52.544982 6159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:52.545215 6137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:01:52.545321 6137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "0994d084f91649728f1ed29f613408fd"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "0802a5978399a79cbdebd25758fc7a67"
server_key_iv: "4e26e80c90064cb5d400ab8c6155e3e0"
server_key_version: "encryptionkey@0"
I20260812 21:01:52.545761 6137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:01:52.560150 6137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:01:52.563357 6137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:01:52.563576 6137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:01:52.563942 6137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:01:52.564399 6137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:01:52.564443 6137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:52.564476 6137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:01:52.564527 6137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:01:52.573333 6137 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:33327
I20260812 21:01:52.573427 6338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:33327 every 8 connection(s)
I20260812 21:01:52.573962 6137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
Aug 12 21:01:52 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:01:52.581943 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 6137
I20260812 21:01:52.586359 5909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.575029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:60683 (local address 127.10.30.126:41655)
0812 21:01:52.575097 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.575099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.575393 (+ 294us) server_negotiation.cc:407] Connection header received
0812 21:01:52.576072 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.576074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.576090 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.576158 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:52.577327 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.577875 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.578983 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.579247 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.579344 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.582451 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:52.582454 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:52.582454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:52.582466 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:52.584385 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.584984 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.584985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.584986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.585062 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.585395 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.585396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.585397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.585549 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:52.585625 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.586066 (+ 441us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.586202 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 21:01:52.586830 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.574976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:60683)
0812 21:01:52.575228 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.575278 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:52.575950 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:52.576242 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:52.576254 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:52.576956 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:01:52.577205 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.577211 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.577985 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.577986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.578865 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.578867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.579377 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.579378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.579519 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.580209 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:01:52.580227 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:01:52.582291 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:01:52.584479 (+ 2188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:52.584490 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:52.584493 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:52.584901 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:52.585165 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:01:52.585166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:01:52.585166 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:01:52.585310 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:01:52.585630 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:01:52.585637 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:01:52.585867 (+ 230us) client_negotiation.cc:769] Sending connection context
0812 21:01:52.586003 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 21:01:52.586246 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":109,"threads_started":1}
I20260812 21:01:52.587679 6340 heartbeater.cc:347] Connected to a master server at 127.10.30.126:41655
I20260812 21:01:52.587826 6340 heartbeater.cc:464] Registering TS with master...
I20260812 21:01:52.588148 6340 heartbeater.cc:511] Master 127.10.30.126:41655 requested a full tablet report, sending...
I20260812 21:01:52.588702 5594 ts_manager.cc:194] Registered new tserver with Master: 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327)
I20260812 21:01:52.589380 5594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:60683
I20260812 21:01:52.590863 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.582588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34296 (local address 127.10.30.126:41655)
0812 21:01:52.582732 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.582734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.582915 (+ 181us) server_negotiation.cc:407] Connection header received
0812 21:01:52.582984 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.582985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.583034 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.583111 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:52.584010 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.584678 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.585756 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.586077 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.586147 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.587828 (+ 1681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:52.587830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:52.587830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:52.587838 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:52.589619 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.590001 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.590002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.590003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.590079 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.590337 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.590339 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.590339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.590484 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:52.590668 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.590700 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.590782 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260812 21:01:52.591956 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:01:52.595142 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.592414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34310 (local address 127.10.30.126:41655)
0812 21:01:52.592456 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.592458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.592620 (+ 162us) server_negotiation.cc:407] Connection header received
0812 21:01:52.592672 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.592673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.592717 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.592783 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:01:52.592947 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.593434 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.594333 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.594583 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.594657 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.594804 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:01:52.594861 (+ 57us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 21:01:52.595074 (+ 213us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34310: token expired
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 21:01:52.595201 6345 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34310: token expired
W20260812 21:01:52.595662 5476 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.30.126:41655)
I20260812 21:01:52.602967 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.595961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34324 (local address 127.10.30.126:41655)
0812 21:01:52.596003 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.596005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.596014 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:01:52.596080 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.596080 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.596095 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.596142 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:01:52.596743 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.597304 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.598128 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.598310 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.598369 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.599880 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:01:52.599882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:01:52.599882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:01:52.599889 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:01:52.601523 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.601918 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.601919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.601920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.601989 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:01:52.602274 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:01:52.602275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:01:52.602276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:01:52.602454 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:01:52.602597 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.602708 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.602811 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 21:01:52.604789 5594 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:01:52.607214 5594 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:01:52.610651 5793 tablet_service.cc:1467] Processing CreateTablet for tablet f4f5d6643efe4689968b0ed47d735e51 (DEFAULT_TABLE table=test-table [id=021cde450cd84495b42f8aa033a5d19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:52.610970 5793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f5d6643efe4689968b0ed47d735e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:52.612989 5717 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Bootstrap starting.
I20260812 21:01:52.613442 5717 tablet_bootstrap.cc:654] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:52.614125 5717 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: No bootstrap required, opened a new log
I20260812 21:01:52.614184 5717 ts_tablet_manager.cc:1397] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 21:01:52.614648 5717 raft_consensus.cc:348] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.614753 5717 raft_consensus.cc:374] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:52.614800 5717 raft_consensus.cc:729] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746d5032ddee45e4bb6d663690e0f449, State: Initialized, Role: FOLLOWER
I20260812 21:01:52.614852 5717 consensus_queue.cc:260] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.614951 5717 ts_tablet_manager.cc:1428] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 21:01:52.615698 6354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.610720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34954 (local address 127.10.30.66:33351)
0812 21:01:52.611455 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.611460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.611470 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:01:52.611550 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.611553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.611575 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.611668 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:52.611792 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.612879 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.614352 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.615098 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.615172 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.615254 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.615531 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.615592 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":186,"threads_started":1}
I20260812 21:01:52.615731 6352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.610548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:33351 (local address 127.0.0.1:34954)
0812 21:01:52.610755 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.610769 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:52.610833 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:52.611677 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:52.611678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:52.611679 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:52.611736 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.611738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.612947 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.612949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.614237 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.614241 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.615297 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.615299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.615384 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.615421 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 21:01:52.615493 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 21:01:52.615564 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":2,"thread_start_us":139,"threads_started":1}
I20260812 21:01:52.615936 6357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.610810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59802 (local address 127.10.30.67:33327)
0812 21:01:52.611104 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.611110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.611123 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:01:52.611181 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.611184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.611205 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.611337 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:52.611522 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.612801 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.614353 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.615233 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.615662 (+ 429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.615740 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.615770 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.615826 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":112,"threads_started":1}
I20260812 21:01:52.615968 5912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.610397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:33327 (local address 127.0.0.1:59802)
0812 21:01:52.610482 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.610497 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:52.610552 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:52.611362 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:52.611363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:52.611366 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:52.611437 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.611439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.612910 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.612912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.614225 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.614230 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.615342 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.615344 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.615427 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.615432 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:01:52.615494 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 21:01:52.615564 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":172}
I20260812 21:01:52.616632 6011 tablet_service.cc:1467] Processing CreateTablet for tablet f4f5d6643efe4689968b0ed47d735e51 (DEFAULT_TABLE table=test-table [id=021cde450cd84495b42f8aa033a5d19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:52.617121 6011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f5d6643efe4689968b0ed47d735e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:52.619849 6232 tablet_service.cc:1467] Processing CreateTablet for tablet f4f5d6643efe4689968b0ed47d735e51 (DEFAULT_TABLE table=test-table [id=021cde450cd84495b42f8aa033a5d19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:01:52.620313 6232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f5d6643efe4689968b0ed47d735e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:01:52.620877 6360 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Bootstrap starting.
I20260812 21:01:52.621608 6360 tablet_bootstrap.cc:654] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:52.622208 6360 log.cc:824] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:52.623415 6360 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: No bootstrap required, opened a new log
I20260812 21:01:52.623512 6360 ts_tablet_manager.cc:1397] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:01:52.624120 6362 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: Bootstrap starting.
I20260812 21:01:52.624858 6362 tablet_bootstrap.cc:654] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: Neither blocks nor log segments found. Creating new log.
I20260812 21:01:52.625427 6362 log.cc:824] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: Log is configured to *not* fsync() on all Append() calls
I20260812 21:01:52.625442 6360 raft_consensus.cc:348] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.625667 6360 raft_consensus.cc:374] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:52.625737 6360 raft_consensus.cc:729] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f12324b931aa4af4920455616e2512ca, State: Initialized, Role: FOLLOWER
I20260812 21:01:52.625905 6360 consensus_queue.cc:260] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.626328 6360 ts_tablet_manager.cc:1428] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:01:52.626355 6130 heartbeater.cc:503] Master 127.10.30.126:41655 was elected leader, sending a full tablet report...
I20260812 21:01:52.626560 6362 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: No bootstrap required, opened a new log
I20260812 21:01:52.626662 6362 ts_tablet_manager.cc:1397] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:01:52.628568 6362 raft_consensus.cc:348] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.628765 6362 raft_consensus.cc:374] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:01:52.628821 6362 raft_consensus.cc:729] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0994d084f91649728f1ed29f613408fd, State: Initialized, Role: FOLLOWER
I20260812 21:01:52.628960 6362 consensus_queue.cc:260] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.629312 6362 ts_tablet_manager.cc:1428] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:01:52.629415 6340 heartbeater.cc:503] Master 127.10.30.126:41655 was elected leader, sending a full tablet report...
W20260812 21:01:52.659361 6131 tablet.cc:2369] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:01:52.673676 5911 raft_consensus.cc:482] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:01:52.673921 5911 raft_consensus.cc:504] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.674486 5911 leader_election.cc:288] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
I20260812 21:01:52.679352 6357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.674912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:40385 (local address 127.10.30.67:33327)
0812 21:01:52.675024 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.675026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.675039 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:01:52.675076 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.675078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.675091 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.675166 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:52.675414 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.676240 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.677972 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.678644 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.678739 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.678754 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.679200 (+ 446us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.679264 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 21:01:52.679356 6354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.675113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:46463 (local address 127.10.30.66:33351)
0812 21:01:52.675184 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.675186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.675195 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:01:52.675229 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.675230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.675249 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.675299 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:01:52.675540 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.676260 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.677973 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.678644 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.678739 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.678753 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.679200 (+ 447us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.679267 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 21:01:52.679352 5908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.674757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:33327 (local address 127.10.30.65:40385)
0812 21:01:52.674831 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.674845 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:52.674912 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:52.675185 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:52.675187 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:52.675189 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:52.675314 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.675318 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.676354 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.676356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.677794 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.677798 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.678770 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.678771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.678877 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.678920 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 21:01:52.679140 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 21:01:52.679215 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":87}
I20260812 21:01:52.679364 6366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.674906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:33351 (local address 127.10.30.65:46463)
0812 21:01:52.675096 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.675105 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 21:01:52.675157 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:01:52.675325 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:01:52.675326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:01:52.675328 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:01:52.675438 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.675440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.676354 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.676356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.677794 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:01:52.677798 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.678803 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.678804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:01:52.678877 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.678921 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 21:01:52.679140 (+ 219us) client_negotiation.cc:240] Negotiation successful
0812 21:01:52.679215 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":29,"thread_start_us":143,"threads_started":1}
I20260812 21:01:52.679976 6053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f5d6643efe4689968b0ed47d735e51" candidate_uuid: "746d5032ddee45e4bb6d663690e0f449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f12324b931aa4af4920455616e2512ca" is_pre_election: true
I20260812 21:01:52.680213 6053 raft_consensus.cc:2454] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746d5032ddee45e4bb6d663690e0f449 in term 0.
I20260812 21:01:52.679970 6274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f5d6643efe4689968b0ed47d735e51" candidate_uuid: "746d5032ddee45e4bb6d663690e0f449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0994d084f91649728f1ed29f613408fd" is_pre_election: true
I20260812 21:01:52.680537 6274 raft_consensus.cc:2454] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746d5032ddee45e4bb6d663690e0f449 in term 0.
I20260812 21:01:52.680610 5712 leader_election.cc:302] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746d5032ddee45e4bb6d663690e0f449, f12324b931aa4af4920455616e2512ca; no voters:
I20260812 21:01:52.680785 5911 raft_consensus.cc:2781] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:01:52.680879 5911 raft_consensus.cc:482] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:01:52.680900 5911 raft_consensus.cc:3037] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:52.681929 5911 raft_consensus.cc:504] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.682088 5911 leader_election.cc:288] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 1 election: Requested vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
I20260812 21:01:52.682353 6274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f5d6643efe4689968b0ed47d735e51" candidate_uuid: "746d5032ddee45e4bb6d663690e0f449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0994d084f91649728f1ed29f613408fd"
I20260812 21:01:52.682403 6053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f5d6643efe4689968b0ed47d735e51" candidate_uuid: "746d5032ddee45e4bb6d663690e0f449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f12324b931aa4af4920455616e2512ca"
I20260812 21:01:52.682507 6274 raft_consensus.cc:3037] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:52.682503 6053 raft_consensus.cc:3037] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:01:52.683605 6053 raft_consensus.cc:2454] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746d5032ddee45e4bb6d663690e0f449 in term 1.
I20260812 21:01:52.683605 6274 raft_consensus.cc:2454] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746d5032ddee45e4bb6d663690e0f449 in term 1.
I20260812 21:01:52.683820 5712 leader_election.cc:302] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746d5032ddee45e4bb6d663690e0f449, f12324b931aa4af4920455616e2512ca; no voters:
I20260812 21:01:52.683997 5911 raft_consensus.cc:2781] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:01:52.684289 5911 raft_consensus.cc:686] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 LEADER]: Becoming Leader. State: Replica: 746d5032ddee45e4bb6d663690e0f449, State: Running, Role: LEADER
I20260812 21:01:52.684381 5911 consensus_queue.cc:237] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:01:52.685789 5594 catalog_manager.cc:5495] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 746d5032ddee45e4bb6d663690e0f449 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "746d5032ddee45e4bb6d663690e0f449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } health_report { overall_health: HEALTHY } } }
I20260812 21:01:52.710686 5913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.707826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43940 (local address 127.10.30.65:35747)
0812 21:01:52.707945 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 21:01:52.707947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:01:52.707955 (+ 8us) server_negotiation.cc:407] Connection header received
0812 21:01:52.708006 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:01:52.708007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:01:52.708031 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:01:52.708125 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:01:52.708292 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.708908 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.709715 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:01:52.709972 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:01:52.710062 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:01:52.710240 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:01:52.710392 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:01:52.710489 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 21:01:52.710534 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 21:01:52.710564 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 21:01:52.712972 6274 raft_consensus.cc:1261] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 1 FOLLOWER]: Refusing update from remote peer 746d5032ddee45e4bb6d663690e0f449: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:52.713030 6053 raft_consensus.cc:1261] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 1 FOLLOWER]: Refusing update from remote peer 746d5032ddee45e4bb6d663690e0f449: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:01:52.713523 5911 consensus_queue.cc:1035] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 21:01:52.713632 5906 tablet.cc:2369] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:01:52.713721 6367 consensus_queue.cc:1035] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:01:52.717487 6372 mvcc.cc:205] Tried to move back new op lower bound from 7317784628068753408 to 7317784627957043200. Current Snapshot: MvccSnapshot[applied={T|T < 7317784628068753408}]
I20260812 21:01:52.717662 6373 mvcc.cc:205] Tried to move back new op lower bound from 7317784628068753408 to 7317784627957043200. Current Snapshot: MvccSnapshot[applied={T|T < 7317784628068753408}]
I20260812 21:01:52.719792 5594 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:52.719946 5594 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:01:52.720974 5594 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Sending DeleteTablet for 3 replicas of tablet f4f5d6643efe4689968b0ed47d735e51
I20260812 21:01:52.721402 6232 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f5d6643efe4689968b0ed47d735e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:52 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:59802
I20260812 21:01:52.721496 6011 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f5d6643efe4689968b0ed47d735e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:52 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:34954
I20260812 21:01:52.721711 5793 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f5d6643efe4689968b0ed47d735e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:01:52 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:43926
I20260812 21:01:52.721850 5915 tablet_replica.cc:330] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: stopping tablet replica
I20260812 21:01:52.721933 5915 raft_consensus.cc:2229] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:01:52.722014 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 5655
I20260812 21:01:52.722043 5915 raft_consensus.cc:2258] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:52.737529 6394 tablet_replica.cc:330] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: stopping tablet replica
I20260812 21:01:52.737771 6394 raft_consensus.cc:2229] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:52.738047 6394 raft_consensus.cc:2258] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:52.741596 6394 ts_tablet_manager.cc:1905] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:52.743543 6392 tablet_replica.cc:330] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: stopping tablet replica
I20260812 21:01:52.743731 6394 ts_tablet_manager.cc:1918] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:52.743762 6392 raft_consensus.cc:2229] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:01:52.743860 6394 log.cc:1196] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/f4f5d6643efe4689968b0ed47d735e51
I20260812 21:01:52.743939 6392 raft_consensus.cc:2258] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:01:52.744244 6394 ts_tablet_manager.cc:1939] T f4f5d6643efe4689968b0ed47d735e51 P f12324b931aa4af4920455616e2512ca: Deleting consensus metadata
I20260812 21:01:52.744633 6392 ts_tablet_manager.cc:1905] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:01:52.744889 5567 catalog_manager.cc:4841] TS f12324b931aa4af4920455616e2512ca (127.10.30.66:33351): tablet f4f5d6643efe4689968b0ed47d735e51 (table test-table [id=021cde450cd84495b42f8aa033a5d19b]) successfully deleted
I20260812 21:01:52.746915 6392 ts_tablet_manager.cc:1918] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:01:52.747047 6392 log.cc:1196] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/f4f5d6643efe4689968b0ed47d735e51
I20260812 21:01:52.747409 6392 ts_tablet_manager.cc:1939] T f4f5d6643efe4689968b0ed47d735e51 P 0994d084f91649728f1ed29f613408fd: Deleting consensus metadata
I20260812 21:01:52.748081 5567 catalog_manager.cc:4841] TS 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327): tablet f4f5d6643efe4689968b0ed47d735e51 (table test-table [id=021cde450cd84495b42f8aa033a5d19b]) successfully deleted
W20260812 21:01:52.750964 5569 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:35747 (error 108)
I20260812 21:01:52.751227 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 5910
I20260812 21:01:52.763074 5912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:01:52.762786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35747 (local address 127.0.0.1:43956)
0812 21:01:52.762884 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 21:01:52.762978 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 21:01:52.763338 5569 catalog_manager.cc:4584] TS 746d5032ddee45e4bb6d663690e0f449 (127.10.30.65:35747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f4f5d6643efe4689968b0ed47d735e51: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35747: connect: Connection refused (error 111)
I20260812 21:01:52.768493 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 6137
I20260812 21:01:52.802516 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 5541
I20260812 21:02:12.821533 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41655
--webserver_interface=127.10.30.126
--webserver_port=46541
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:41655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:12.932684 6396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:12.933017 6396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:12.933049 6396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:12.934827 6396 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 21:02:12.934913 6396 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 21:02:12.934928 6396 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 21:02:12.934942 6396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:12.934960 6396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:12.934975 6396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:12.935056 6396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:12.935079 6396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:12.937193 6396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:41655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:41655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=46541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:12.937611 6396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:12.937953 6396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:12.944720 6412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:12.944664 6404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:12.944754 6405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:12.945029 6396 server_base.cc:1034] running on GCE node
I20260812 21:02:12.945420 6396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:12.945780 6396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:12.947062 6396 hybrid_clock.cc:648] HybridClock initialized: now 1786568532946978 us; error 40 us; skew 500 ppm
Aug 12 21:02:12 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568532, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:12.950742 6396 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:02:12.951467 6396 webserver.cc:460] Webserver started at http://127.10.30.126:46541/ using document root <none> and password file <none>
I20260812 21:02:12.951788 6396 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:12.951875 6396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:12.953727 6396 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 21:02:12.954818 6422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:12.955189 6396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:12.955327 6396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "ac6325813fabec54592c4ad1495b4708"
server_key_iv: "99add7454eed9cac0f99b66d382b2728"
server_key_version: "encryptionkey@0"
I20260812 21:02:12.955852 6396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:12.970624 6396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:12.973711 6396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:12.973868 6396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:12.980506 6396 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:41655
I20260812 21:02:12.981052 6514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:41655 every 8 connection(s)
I20260812 21:02:12.981137 6396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:12.982967 6516 sys_catalog.cc:263] Verifying existing consensus state
I20260812 21:02:12.983826 6516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Bootstrap starting.
I20260812 21:02:12.991159 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 6396
I20260812 21:02:12.991647 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:35747
--local_ip_for_outbound_sockets=127.10.30.65
--tserver_master_addrs=127.10.30.126:41655
--webserver_port=45673
--webserver_interface=127.10.30.65
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:02:12.995558 6516 log.cc:824] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:12.998611 6516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:02:12.999090 6516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Bootstrap complete.
I20260812 21:02:13.001896 6516 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:02:13.002203 6516 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdc1b8bf3114d7fb9591f970e49d0dd, State: Initialized, Role: FOLLOWER
I20260812 21:02:13.002416 6516 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:02:13.002549 6516 raft_consensus.cc:388] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:13.002650 6516 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:13.002713 6516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 2 FOLLOWER]: Advancing to term 3
I20260812 21:02:13.004000 6516 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:02:13.004145 6516 leader_election.cc:302] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdc1b8bf3114d7fb9591f970e49d0dd; no voters:
I20260812 21:02:13.004387 6516 leader_election.cc:288] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 21:02:13.004433 6522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 3 FOLLOWER]: Leader election won for term 3
I20260812 21:02:13.004570 6522 raft_consensus.cc:686] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [term 3 LEADER]: Becoming Leader. State: Replica: ecdc1b8bf3114d7fb9591f970e49d0dd, State: Running, Role: LEADER
I20260812 21:02:13.004674 6522 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } }
I20260812 21:02:13.004740 6516 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:13.005031 6522 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecdc1b8bf3114d7fb9591f970e49d0dd. Latest consensus state: current_term: 3 leader_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } } }
I20260812 21:02:13.005143 6522 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:13.005045 6525 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdc1b8bf3114d7fb9591f970e49d0dd" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 41655 } } }
I20260812 21:02:13.005461 6525 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:13.005785 6530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:13.007203 6530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:13.007534 6530 catalog_manager.cc:1259] Loaded cluster ID: 54ae799c6d79423b93fbf4afd8d5a744
I20260812 21:02:13.007735 6530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:13.009135 6530 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:13.009361 6530 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Loaded TSK: 0
I20260812 21:02:13.009410 6530 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ecdc1b8bf3114d7fb9591f970e49d0dd: Loaded TSK: 1
F20260812 21:02:13.009709 6530 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2c5d3fe9ad google::LogMessage::Fail() at ??:0
@ 0x7f2c5d40188a google::LogMessage::SendToLog() at ??:0
@ 0x7f2c5d3fe4de google::LogMessage::Flush() at ??:0
@ 0x7f2c5d3ffa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2c5fb6b104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f2c5fb68d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f2c653581cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f2c6535848e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f2c65358594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f2c6531ec48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f2c65328ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2c5f2cc0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2c5f2c1954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2c601256db start_thread at ??:0
@ 0x7f2c5befc61f clone at ??:0
W20260812 21:02:13.142874 6518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:13.143247 6518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:13.143283 6518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:13.144793 6518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:13.144851 6518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:13.144883 6518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:02:13.146674 6518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:35747
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=45673
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:13.146989 6518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:13.147356 6518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:13.153609 6572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:13.153565 6570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:13.153786 6569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:13.154951 6518 server_base.cc:1034] running on GCE node
I20260812 21:02:13.155301 6518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:13.155678 6518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:13.156858 6518 hybrid_clock.cc:648] HybridClock initialized: now 1786568533156829 us; error 52 us; skew 500 ppm
Aug 12 21:02:13 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:13.160518 6518 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:02:13.161170 6518 webserver.cc:460] Webserver started at http://127.10.30.65:45673/ using document root <none> and password file <none>
I20260812 21:02:13.161463 6518 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:13.161540 6518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:13.163400 6518 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:02:13.164413 6588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:13.164719 6518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:13.164852 6518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "746d5032ddee45e4bb6d663690e0f449"
format_stamp: "Formatted at 2026-08-12 21:01:30 on dist-test-slave-h3ft"
server_key: "1e8313ba3be5811f2bd1ae093bf8328c"
server_key_iv: "64ab3b391346e423ea87d80deb197915"
server_key_version: "encryptionkey@0"
I20260812 21:02:13.165395 6518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:13.180954 6518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:13.183801 6518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:13.184010 6518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:13.184319 6518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:13.184952 6599 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 21:02:13.187418 6518 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 21:02:13.187541 6518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260812 21:02:13.187606 6518 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 21:02:13.188580 6518 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 21:02:13.188656 6518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 21:02:13.188760 6599 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Bootstrap starting.
I20260812 21:02:13.198794 6518 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:35747
I20260812 21:02:13.199208 6754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:35747 every 8 connection(s)
I20260812 21:02:13.199426 6518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:02:13.201046 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 6518
I20260812 21:02:13.202680 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:33351
--local_ip_for_outbound_sockets=127.10.30.66
--tserver_master_addrs=127.10.30.126:41655
--webserver_port=44637
--webserver_interface=127.10.30.66
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:02:13.203414 6599 log.cc:824] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:13.206666 6599 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 21:02:13.207126 6599 tablet_bootstrap.cc:492] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Bootstrap complete.
I20260812 21:02:13.208487 6599 ts_tablet_manager.cc:1397] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.006s
I20260812 21:02:13.209985 6599 raft_consensus.cc:348] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:02:13.210307 6599 raft_consensus.cc:729] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746d5032ddee45e4bb6d663690e0f449, State: Initialized, Role: FOLLOWER
I20260812 21:02:13.210536 6599 consensus_queue.cc:260] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:02:13.210987 6599 ts_tablet_manager.cc:1428] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
W20260812 21:02:13.291349 6761 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:02:13.200424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:47349)
0812 21:02:13.200714 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.200766 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:13.201756 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:13.291082 (+ 89326us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":151,"threads_started":1}
W20260812 21:02:13.291795 6757 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:41655 (0 consecutive failures): Network error: Failed to ping master at 127.10.30.126:41655: Client connection negotiation failed: client connection to 127.10.30.126:41655: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 21:02:13.292340 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:13.292138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:54759)
0812 21:02:13.292222 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.292299 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 21:02:13.292819 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:13.292684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:38401)
0812 21:02:13.292747 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.292790 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 21:02:13.292992 6757 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 21:02:13.312556 6763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:13.312978 6763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:13.313036 6763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:13.315058 6763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:13.315140 6763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:13.315208 6763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:02:13.317130 6763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:33351
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=44637
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:13.317442 6763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:13.317736 6763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:13.324414 6776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:13.324462 6773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:13.324688 6763 server_base.cc:1034] running on GCE node
W20260812 21:02:13.324429 6781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:13.325242 6763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:13.325531 6763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:13.326763 6763 hybrid_clock.cc:648] HybridClock initialized: now 1786568533326740 us; error 43 us; skew 500 ppm
Aug 12 21:02:13 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:13.330093 6763 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:02:13.330727 6763 webserver.cc:460] Webserver started at http://127.10.30.66:44637/ using document root <none> and password file <none>
I20260812 21:02:13.331056 6763 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:13.331131 6763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:13.332859 6763 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:13.333745 6793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:13.334111 6763 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:13.334373 6763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "f12324b931aa4af4920455616e2512ca"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "dfc560990d1e542d53aaddb881ee2d27"
server_key_iv: "a6ebc916e854dd2e548ae3c98c39ff0e"
server_key_version: "encryptionkey@0"
I20260812 21:02:13.334833 6763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:13.352003 6763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:13.354900 6763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:13.355149 6763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:13.355448 6763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:13.355857 6763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:13.355926 6763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:13.355976 6763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:13.356009 6763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:13.364686 6763 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:33351
I20260812 21:02:13.364753 6963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:33351 every 8 connection(s)
I20260812 21:02:13.365170 6763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:02:13.366807 6967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:13.366172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:36977)
0812 21:02:13.366429 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.366587 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":81,"threads_started":1}
W20260812 21:02:13.367396 6964 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:41655 (0 consecutive failures): Network error: Failed to ping master at 127.10.30.126:41655: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
I20260812 21:02:13.367813 6967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:13.367688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:57265)
0812 21:02:13.367751 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.367790 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 21:02:13.368438 6967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:13.368249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:34843)
0812 21:02:13.368351 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.368400 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260812 21:02:13.368680 6964 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 21:02:13.372876 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 6763
I20260812 21:02:13.373302 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:33327
--local_ip_for_outbound_sockets=127.10.30.67
--tserver_master_addrs=127.10.30.126:41655
--webserver_port=32839
--webserver_interface=127.10.30.67
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:40485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:13.475703 6968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:13.475997 6968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:13.476030 6968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:13.477378 6968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:13.477432 6968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:13.477464 6968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:02:13.479487 6968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:40485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:33327
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=32839
--tserver_master_addrs=127.10.30.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:13.479862 6968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:13.480222 6968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:13.487123 6980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:13.487123 6978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:13.487166 6982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:13.487382 6968 server_base.cc:1034] running on GCE node
I20260812 21:02:13.487854 6968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:13.488226 6968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:13.489423 6968 hybrid_clock.cc:648] HybridClock initialized: now 1786568533489393 us; error 54 us; skew 500 ppm
Aug 12 21:02:13 dist-test-slave-h3ft krb5kdc[4599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:13.493206 6968 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:02:13.493824 6968 webserver.cc:460] Webserver started at http://127.10.30.67:32839/ using document root <none> and password file <none>
I20260812 21:02:13.494194 6968 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:13.494280 6968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:13.496209 6968 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:13.497329 6991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:13.497705 6968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:13.497859 6968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "0994d084f91649728f1ed29f613408fd"
format_stamp: "Formatted at 2026-08-12 21:01:31 on dist-test-slave-h3ft"
server_key: "0802a5978399a79cbdebd25758fc7a67"
server_key_iv: "4e26e80c90064cb5d400ab8c6155e3e0"
server_key_version: "encryptionkey@0"
I20260812 21:02:13.498377 6968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:13.517436 6968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:13.520326 6968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:13.520529 6968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:13.520862 6968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:13.521250 6968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:13.521307 6968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:13.521360 6968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:13.521391 6968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:13.529819 6968 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:33327
I20260812 21:02:13.529873 7179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:33327 every 8 connection(s)
I20260812 21:02:13.530385 6968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:02:13.532063 7186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:13.531443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:39887)
0812 21:02:13.531702 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.531797 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":113,"threads_started":1}
W20260812 21:02:13.532683 7182 heartbeater.cc:644] Failed to heartbeat to 127.10.30.126:41655 (0 consecutive failures): Network error: Failed to ping master at 127.10.30.126:41655: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
I20260812 21:02:13.533098 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 6968
I20260812 21:02:13.533134 7186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:13.532995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:59587)
0812 21:02:13.533070 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.533107 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 21:02:13.533658 7186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:13.533536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:55611)
0812 21:02:13.533592 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:13.533629 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 21:02:13.533855 7182 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 21:02:14.294104 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:14.293609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:38017)
0812 21:02:14.293908 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:14.294013 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":151,"threads_started":1}
I20260812 21:02:14.369580 7192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:14.369187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:53343)
0812 21:02:14.369419 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:14.369491 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":105,"threads_started":1}
I20260812 21:02:14.534633 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:14.534302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:34103)
0812 21:02:14.534500 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:14.534553 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":105,"threads_started":1}
I20260812 21:02:15.075512 7197 raft_consensus.cc:482] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:15.075723 7197 raft_consensus.cc:504] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:02:15.076328 7197 leader_election.cc:288] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
Aug 12 21:02:15 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.67@KRBTEST.COM
Aug 12 21:02:15 dist-test-slave-h3ft krb5kdc[4599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.66@KRBTEST.COM
I20260812 21:02:15.091125 7201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:15.077124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:34007 (local address 127.10.30.66:33351)
0812 21:02:15.077345 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:15.077358 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:15.077384 (+ 26us) server_negotiation.cc:407] Connection header received
0812 21:02:15.077975 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:15.077977 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:15.078036 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:15.078215 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:15.079251 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:15.080230 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:15.081548 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:15.082041 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:15.082185 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:15.086097 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:15.086103 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:15.086103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:15.086119 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:15.088488 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:15.089476 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:15.089481 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:15.089482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:15.089631 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:15.089960 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:15.089961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:15.089961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:15.090294 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:15.090407 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:15.090758 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 21:02:15.090934 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":115,"threads_started":1}
I20260812 21:02:15.091104 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:15.076833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:33351 (local address 127.10.30.65:34007)
0812 21:02:15.077049 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:15.077064 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:15.077163 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:15.078244 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:15.078248 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:15.078754 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:15.079101 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:15.079111 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:15.080369 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:15.080370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:15.081422 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:15.081426 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:15.082155 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:15.082156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:15.082299 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:15.083414 (+ 1115us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:15.083426 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:15.085890 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:15.088698 (+ 2808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:15.088700 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:15.088700 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:15.089258 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:15.089717 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:15.089718 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:15.089718 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:15.089869 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:15.090379 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:15.090387 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:15.090550 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 21:02:15.090684 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 21:02:15.090951 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":87,"thread_start_us":48,"threads_started":1}
I20260812 21:02:15.091171 7200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:15.076812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:57657 (local address 127.10.30.67:33327)
0812 21:02:15.077350 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:15.077365 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:15.077400 (+ 35us) server_negotiation.cc:407] Connection header received
0812 21:02:15.077957 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:15.077960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:15.078008 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:15.078189 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:15.079257 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:15.080286 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:15.081533 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:15.082024 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:15.082163 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:15.085677 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:15.085684 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:15.085685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:15.085700 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:15.088495 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:15.089420 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:15.089427 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:15.089427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:15.089590 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:15.089971 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:15.089973 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:15.089973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:15.090324 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:15.090436 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:15.090756 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 21:02:15.090973 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":74,"threads_started":1}
I20260812 21:02:15.091291 7198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:15.076583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:33327 (local address 127.10.30.65:57657)
0812 21:02:15.076864 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:15.076883 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:15.076985 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:15.078246 (+ 1261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:15.078250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:15.078791 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:15.079102 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:15.079113 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:15.080426 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:15.080427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:15.081423 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:15.081425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:15.082159 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:15.082160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:15.082299 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:15.083417 (+ 1118us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:15.083430 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:15.085427 (+ 1997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:15.088678 (+ 3251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:15.088690 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:15.088693 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:15.089264 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:15.089744 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:15.089745 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:15.089748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:15.089874 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:15.090421 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:15.090422 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:15.090551 (+ 129us) client_negotiation.cc:769] Sending connection context
0812 21:02:15.090684 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 21:02:15.091084 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":212,"thread_start_us":106,"threads_started":1}
W20260812 21:02:15.093050 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
W20260812 21:02:15.093189 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f12324b931aa4af4920455616e2512ca (127.10.30.66:33351): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
I20260812 21:02:15.093250 6590 leader_election.cc:302] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746d5032ddee45e4bb6d663690e0f449; no voters: 0994d084f91649728f1ed29f613408fd, f12324b931aa4af4920455616e2512ca
I20260812 21:02:15.093405 7197 raft_consensus.cc:2726] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:02:15.295104 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:15.294774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:46131)
0812 21:02:15.294910 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:15.294994 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 21:02:15.370838 7203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:15.370287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:49745)
0812 21:02:15.370509 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:15.370753 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":142,"threads_started":1}
I20260812 21:02:15.536007 7204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:15.535504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:52703)
0812 21:02:15.535811 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:15.535934 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":115,"threads_started":1}
I20260812 21:02:16.296341 7205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:16.296001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:60097)
0812 21:02:16.296209 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:16.296285 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":99,"threads_started":1}
I20260812 21:02:16.371969 7207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:16.371599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:42237)
0812 21:02:16.371814 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:16.371896 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":92,"threads_started":1}
I20260812 21:02:16.537111 7210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:16.536738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:55653)
0812 21:02:16.536968 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:16.537041 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":109,"threads_started":1}
I20260812 21:02:16.878836 7211 raft_consensus.cc:482] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:16.878975 7211 raft_consensus.cc:504] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:02:16.879277 7211 leader_election.cc:288] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
W20260812 21:02:16.880159 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f12324b931aa4af4920455616e2512ca (127.10.30.66:33351): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
W20260812 21:02:16.880242 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
I20260812 21:02:16.880263 6590 leader_election.cc:302] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746d5032ddee45e4bb6d663690e0f449; no voters: 0994d084f91649728f1ed29f613408fd, f12324b931aa4af4920455616e2512ca
I20260812 21:02:16.880366 7211 raft_consensus.cc:2726] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:02:17.297385 7212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:17.297009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:58741)
0812 21:02:17.297210 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:17.297272 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":78,"threads_started":1}
I20260812 21:02:17.373148 7213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:17.372764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:58181)
0812 21:02:17.372991 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:17.373063 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":93,"threads_started":1}
I20260812 21:02:17.538188 7215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:17.537836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:48469)
0812 21:02:17.538034 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:17.538110 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":83,"threads_started":1}
I20260812 21:02:18.298687 7216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:18.298339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:36139)
0812 21:02:18.298541 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:18.298614 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":90,"threads_started":1}
I20260812 21:02:18.374397 7219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:18.374005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:50763)
0812 21:02:18.374226 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:18.374302 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":101,"threads_started":1}
I20260812 21:02:18.539324 7220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:18.538965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:50821)
0812 21:02:18.539211 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:18.539254 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":163,"threads_started":1}
I20260812 21:02:18.662496 7221 raft_consensus.cc:482] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:18.662644 7221 raft_consensus.cc:504] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:02:18.662843 7221 leader_election.cc:288] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
W20260812 21:02:18.663486 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
W20260812 21:02:18.663594 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f12324b931aa4af4920455616e2512ca (127.10.30.66:33351): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
I20260812 21:02:18.663632 6590 leader_election.cc:302] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746d5032ddee45e4bb6d663690e0f449; no voters: 0994d084f91649728f1ed29f613408fd, f12324b931aa4af4920455616e2512ca
I20260812 21:02:18.663739 7221 raft_consensus.cc:2726] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:02:19.299773 7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:19.299436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:60209)
0812 21:02:19.299657 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:19.299704 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":107,"threads_started":1}
I20260812 21:02:19.375375 7223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:19.375066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:60145)
0812 21:02:19.375260 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:19.375304 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":112,"threads_started":1}
I20260812 21:02:19.540237 7225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:19.539887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:54657)
0812 21:02:19.540105 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:19.540162 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":135,"threads_started":1}
I20260812 21:02:20.300963 7228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:20.300544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:47855)
0812 21:02:20.300757 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:20.300838 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":94,"threads_started":1}
I20260812 21:02:20.376452 7229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:20.376099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:53477)
0812 21:02:20.376329 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:20.376392 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":101,"threads_started":1}
I20260812 21:02:20.541379 7230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:20.540946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:48697)
0812 21:02:20.541225 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:20.541310 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":83,"threads_started":1}
I20260812 21:02:20.647606 7231 raft_consensus.cc:482] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:20.647907 7231 raft_consensus.cc:504] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:02:20.648201 7231 leader_election.cc:288] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
W20260812 21:02:20.648838 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f12324b931aa4af4920455616e2512ca (127.10.30.66:33351): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
W20260812 21:02:20.648955 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
I20260812 21:02:20.648973 6590 leader_election.cc:302] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746d5032ddee45e4bb6d663690e0f449; no voters: 0994d084f91649728f1ed29f613408fd, f12324b931aa4af4920455616e2512ca
I20260812 21:02:20.649085 7231 raft_consensus.cc:2726] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:02:21.301988 7235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:21.301676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:38659)
0812 21:02:21.301879 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:21.301929 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":92,"threads_started":1}
I20260812 21:02:21.377485 7236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:21.377177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:39331)
0812 21:02:21.377366 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:21.377425 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
I20260812 21:02:21.542464 7240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:21.542107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:33529)
0812 21:02:21.542311 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:21.542395 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":104,"threads_started":1}
I20260812 21:02:22.303097 7243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:22.302695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:53135)
0812 21:02:22.302893 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:22.302988 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260812 21:02:22.378552 7244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:22.378158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:45885)
0812 21:02:22.378417 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:22.378490 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":123,"threads_started":1}
I20260812 21:02:22.543478 7246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:22.543129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:50647)
0812 21:02:22.543342 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:22.543411 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":89,"threads_started":1}
I20260812 21:02:23.304277 7247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:23.303918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:54761)
0812 21:02:23.304128 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:23.304204 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":94,"threads_started":1}
I20260812 21:02:23.379822 7248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:23.379442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:45907)
0812 21:02:23.379675 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:23.379746 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":110,"threads_started":1}
I20260812 21:02:23.544633 7249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:23.544284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:49705)
0812 21:02:23.544496 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:23.544563 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":98,"threads_started":1}
I20260812 21:02:24.305294 7250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:24.304955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:60653)
0812 21:02:24.305168 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:24.305235 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":114,"threads_started":1}
I20260812 21:02:24.380930 7252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:24.380593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:58097)
0812 21:02:24.380801 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:24.380862 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":108,"threads_started":1}
I20260812 21:02:24.545909 7255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:24.545507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:45825)
0812 21:02:24.545741 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:24.545836 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":87,"threads_started":1}
I20260812 21:02:25.306255 7256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:25.305890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:59567)
0812 21:02:25.306116 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:25.306182 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":104,"threads_started":1}
I20260812 21:02:25.381875 7258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:25.381592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:35563)
0812 21:02:25.381775 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:25.381818 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":92,"threads_started":1}
I20260812 21:02:25.443893 7263 raft_consensus.cc:482] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:25.444031 7263 raft_consensus.cc:504] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0994d084f91649728f1ed29f613408fd" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 33327 } } peers { permanent_uuid: "f12324b931aa4af4920455616e2512ca" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 33351 } } peers { permanent_uuid: "746d5032ddee45e4bb6d663690e0f449" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35747 } }
I20260812 21:02:25.444249 7263 leader_election.cc:288] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327), f12324b931aa4af4920455616e2512ca (127.10.30.66:33351)
W20260812 21:02:25.444906 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f12324b931aa4af4920455616e2512ca (127.10.30.66:33351): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
W20260812 21:02:25.445024 6590 leader_election.cc:341] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0994d084f91649728f1ed29f613408fd (127.10.30.67:33327): Not found: Tablet not found: f4f5d6643efe4689968b0ed47d735e51
I20260812 21:02:25.445045 6590 leader_election.cc:302] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746d5032ddee45e4bb6d663690e0f449; no voters: 0994d084f91649728f1ed29f613408fd, f12324b931aa4af4920455616e2512ca
I20260812 21:02:25.445169 7263 raft_consensus.cc:2726] T f4f5d6643efe4689968b0ed47d735e51 P 746d5032ddee45e4bb6d663690e0f449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 21:02:25.546993 7264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:25.546635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:49865)
0812 21:02:25.546871 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:25.546933 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":116,"threads_started":1}
I20260812 21:02:26.307403 7265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:26.306998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:37945)
0812 21:02:26.307288 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:26.307346 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":100,"threads_started":1}
I20260812 21:02:26.382846 7267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:26.382535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:38403)
0812 21:02:26.382742 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:26.382789 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":120,"threads_started":1}
I20260812 21:02:26.548002 7268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:26.547667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:53795)
0812 21:02:26.547859 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:26.547929 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":82,"threads_started":1}
I20260812 21:02:27.308615 7270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:27.308130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:42431)
0812 21:02:27.308379 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:27.308449 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":125,"threads_started":1}
I20260812 21:02:27.383836 7271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:27.383413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:55577)
0812 21:02:27.383697 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:27.383749 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":117,"threads_started":1}
I20260812 21:02:27.549168 7273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:27.548824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:51175)
0812 21:02:27.549044 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:27.549110 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":104,"threads_started":1}
I20260812 21:02:28.310051 7274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:28.309582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.65:44111)
0812 21:02:28.309907 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:28.309981 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":173,"threads_started":1}
I20260812 21:02:28.384912 7275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:28.384553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.66:42087)
0812 21:02:28.384735 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:28.384837 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
I20260812 21:02:28.535326 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 6518
I20260812 21:02:28.562291 7276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:28.549822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:41655 (local address 127.10.30.67:48151)
0812 21:02:28.562116 (+ 12294us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:28.562203 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.126:41655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12256,"thread_start_us":3769,"threads_started":1}
I20260812 21:02:28.571362 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 6763
I20260812 21:02:28.594364 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 6968
2026-08-12T21:02:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59619 ms)
[----------] 30 tests from SecurityITest (272684 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:28 dist-test-slave-h3ft krb5kdc[7279](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:28 dist-test-slave-h3ft krb5kdc[7279](info): set up 2 sockets
Aug 12 21:02:28 dist-test-slave-h3ft krb5kdc[7279](info): commencing operation
krb5kdc: starting...
W20260812 21:02:29.975692 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.353s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:02:30.139847 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:40097
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:40097
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:30.240015 7298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:30.240309 7298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:30.240336 7298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:30.241716 7298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:30.241775 7298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:30.241791 7298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:30.241803 7298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:30.241816 7298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:30.243654 7298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:40097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:40097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:30.244001 7298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:30.244308 7298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:30.250715 7309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:30.250734 7298 server_base.cc:1034] running on GCE node
W20260812 21:02:30.251060 7307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:30.250734 7311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:30.251538 7298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:30.251921 7298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:30.253144 7298 hybrid_clock.cc:648] HybridClock initialized: now 1786568550253121 us; error 44 us; skew 500 ppm
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:30.256640 7298 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:02:30.257244 7298 webserver.cc:460] Webserver started at http://127.10.30.126:33779/ using document root <none> and password file <none>
I20260812 21:02:30.257532 7298 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:30.257606 7298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:30.257773 7298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:30.259334 7298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "4f9e32a09e59462e85f65fe629d8cadf"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "5fa6e725ff88bcb0687c9aefbd458cbd"
server_key_iv: "7387d215f45360e98859f431bcd9adda"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.259779 7298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "4f9e32a09e59462e85f65fe629d8cadf"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "5fa6e725ff88bcb0687c9aefbd458cbd"
server_key_iv: "7387d215f45360e98859f431bcd9adda"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.261432 7298 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:02:30.262351 7318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.262566 7298 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:30.262696 7298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "4f9e32a09e59462e85f65fe629d8cadf"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "5fa6e725ff88bcb0687c9aefbd458cbd"
server_key_iv: "7387d215f45360e98859f431bcd9adda"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.262778 7298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:30.292091 7298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:30.295308 7298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:30.295565 7298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:30.301205 7298 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:40097
I20260812 21:02:30.301373 7398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:40097 every 8 connection(s)
I20260812 21:02:30.301759 7298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:30.302970 7400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:30.305922 7400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf: Bootstrap starting.
I20260812 21:02:30.306679 7400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:30.306993 7400 log.cc:824] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:30.308048 7400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf: No bootstrap required, opened a new log
I20260812 21:02:30.309099 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 7298
I20260812 21:02:30.309363 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:30.309619 10361 external_mini_cluster.cc:1428] Setting key 758ccd0fd5a2969a4256b0c5976fa697
I20260812 21:02:30.310429 7400 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9e32a09e59462e85f65fe629d8cadf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40097 } }
I20260812 21:02:30.310654 7400 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:30.310721 7400 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f9e32a09e59462e85f65fe629d8cadf, State: Initialized, Role: FOLLOWER
I20260812 21:02:30.310889 7400 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9e32a09e59462e85f65fe629d8cadf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40097 } }
I20260812 21:02:30.310985 7400 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:30.311062 7400 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:30.311127 7400 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:30.312392 7400 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9e32a09e59462e85f65fe629d8cadf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40097 } }
I20260812 21:02:30.312577 7400 leader_election.cc:302] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f9e32a09e59462e85f65fe629d8cadf; no voters:
I20260812 21:02:30.312820 7400 leader_election.cc:288] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:30.312888 7408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:30.313055 7408 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [term 1 LEADER]: Becoming Leader. State: Replica: 4f9e32a09e59462e85f65fe629d8cadf, State: Running, Role: LEADER
I20260812 21:02:30.313181 7400 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:30.313239 7408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9e32a09e59462e85f65fe629d8cadf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40097 } }
I20260812 21:02:30.314519 7410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f9e32a09e59462e85f65fe629d8cadf. Latest consensus state: current_term: 1 leader_uuid: "4f9e32a09e59462e85f65fe629d8cadf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9e32a09e59462e85f65fe629d8cadf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40097 } } }
I20260812 21:02:30.314637 7410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:30.314993 7413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f9e32a09e59462e85f65fe629d8cadf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9e32a09e59462e85f65fe629d8cadf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 40097 } } }
W20260812 21:02:30.315524 7434 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 21:02:30.315697 7413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf [sys.catalog]: This master's current role is: LEADER
W20260812 21:02:30.315708 7434 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:02:30.315814 7440 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:30.316012 7440 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:30.317890 7440 catalog_manager.cc:1347] Generated new cluster ID: ea2ed22a11a444eaba7829b00b01e743
I20260812 21:02:30.317946 7440 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:30.322886 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.310400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46272 (local address 127.10.30.126:40097)
0812 21:02:30.310661 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:30.310671 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:30.310734 (+ 63us) server_negotiation.cc:407] Connection header received
0812 21:02:30.310908 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:30.310921 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:30.310979 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:30.311242 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:30.312084 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.313432 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.314773 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.315466 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.315594 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.319131 (+ 3537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:30.319137 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:30.319138 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:30.319153 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:30.321087 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.321557 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.321561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.321562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.321678 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.321912 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.321913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.321914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.322205 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:30.322469 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:30.322549 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 21:02:30.322707 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":144,"threads_started":1}
I20260812 21:02:30.342078 7440 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:30.342795 7440 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:30.346752 7440 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf: Generated new TSK 0
I20260812 21:02:30.347070 7440 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 21:02:30.391572 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40097
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:30.503157 7447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:30.503472 7447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:30.503510 7447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:30.505137 7447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:30.505209 7447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:30.505246 7447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:02:30.507427 7447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:30.507797 7447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:30.508167 7447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:30.514752 7458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:30.514907 7447 server_base.cc:1034] running on GCE node
W20260812 21:02:30.514751 7461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:30.514753 7455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:30.515408 7447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:30.515743 7447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:30.516927 7447 hybrid_clock.cc:648] HybridClock initialized: now 1786568550516914 us; error 43 us; skew 500 ppm
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:30.520495 7447 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:02:30.521116 7447 webserver.cc:460] Webserver started at http://127.10.30.65:44039/ using document root <none> and password file <none>
I20260812 21:02:30.521443 7447 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:30.521521 7447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:30.521690 7447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:30.523119 7447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "75ccf2035b1044448b55a20b78462e8c"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "77a60629c6ad5aaf636293e74d443ba7"
server_key_iv: "4a6f1b80e7fd3e79d46ea9213a0e06c0"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.523583 7447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "75ccf2035b1044448b55a20b78462e8c"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "77a60629c6ad5aaf636293e74d443ba7"
server_key_iv: "4a6f1b80e7fd3e79d46ea9213a0e06c0"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.525269 7447 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 21:02:30.526305 7470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.526582 7447 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:30.526718 7447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "75ccf2035b1044448b55a20b78462e8c"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "77a60629c6ad5aaf636293e74d443ba7"
server_key_iv: "4a6f1b80e7fd3e79d46ea9213a0e06c0"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.526816 7447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:30.547511 7447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:30.550413 7447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:30.550616 7447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:30.550951 7447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:30.551385 7447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:30.551442 7447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.551488 7447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:30.551517 7447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.558979 7447 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:34813
I20260812 21:02:30.559058 7646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:34813 every 8 connection(s)
I20260812 21:02:30.559480 7447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:02:30.561136 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 7447
I20260812 21:02:30.561285 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:02:30.561579 10361 external_mini_cluster.cc:1428] Setting key 5d8c2c03ec8770854948b9cd676e118d
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:30.571120 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.560455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:43733 (local address 127.10.30.126:40097)
0812 21:02:30.560516 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:30.560519 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:30.560751 (+ 232us) server_negotiation.cc:407] Connection header received
0812 21:02:30.561501 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:30.561502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:30.561525 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:30.561581 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:30.562917 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.563545 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.564645 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.564958 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.565024 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.567928 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:30.567930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:30.567931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:30.567940 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:30.569511 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.569971 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.569972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.569973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.570043 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.570317 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.570318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.570319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.570462 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:30.570542 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:30.570857 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 21:02:30.570982 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 21:02:30.571336 7650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.560375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:40097 (local address 127.10.30.65:43733)
0812 21:02:30.560589 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:30.560640 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:30.561354 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:30.561689 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:30.561694 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:30.562567 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:30.562810 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.562815 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.563646 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.563647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.564518 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.564520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.565051 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.565052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.565218 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.565953 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:30.565966 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:30.567810 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:30.569619 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:30.569628 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:30.569632 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:30.569892 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:30.570112 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:30.570114 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:30.570114 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:30.570242 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:30.570530 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:30.570539 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:30.570708 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 21:02:30.570824 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 21:02:30.571048 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
I20260812 21:02:30.572041 7648 heartbeater.cc:347] Connected to a master server at 127.10.30.126:40097
I20260812 21:02:30.572151 7648 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:30.572387 7648 heartbeater.cc:511] Master 127.10.30.126:40097 requested a full tablet report, sending...
I20260812 21:02:30.573180 7341 ts_manager.cc:194] Registered new tserver with Master: 75ccf2035b1044448b55a20b78462e8c (127.10.30.65:34813)
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
I20260812 21:02:30.574115 7341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:43733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 21:02:30.599654 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40097
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:30.702116 7659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:30.702414 7659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:30.702443 7659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:30.703835 7659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:30.703894 7659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:30.703924 7659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:02:30.705571 7659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:30.705935 7659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:30.706287 7659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:30.712699 7667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:30.712695 7669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:30.712723 7672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:30.713264 7659 server_base.cc:1034] running on GCE node
I20260812 21:02:30.713563 7659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:30.713902 7659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:30.715112 7659 hybrid_clock.cc:648] HybridClock initialized: now 1786568550715073 us; error 51 us; skew 500 ppm
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:30.718396 7659 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:02:30.718955 7659 webserver.cc:460] Webserver started at http://127.10.30.66:32861/ using document root <none> and password file <none>
I20260812 21:02:30.719301 7659 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:30.719374 7659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:30.719552 7659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:30.720891 7659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "8710c1b2a85a4d9fad7f03766b998f9c"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "45666d98bda1239f9ca5e29ff95bd4d1"
server_key_iv: "c1b67753e1f1df994e0ea3a1a58b1a1d"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.721359 7659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "8710c1b2a85a4d9fad7f03766b998f9c"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "45666d98bda1239f9ca5e29ff95bd4d1"
server_key_iv: "c1b67753e1f1df994e0ea3a1a58b1a1d"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.723482 7659 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 21:02:30.724493 7683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.724696 7659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:30.724807 7659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "8710c1b2a85a4d9fad7f03766b998f9c"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "45666d98bda1239f9ca5e29ff95bd4d1"
server_key_iv: "c1b67753e1f1df994e0ea3a1a58b1a1d"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.724903 7659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:30.748389 7659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:30.751458 7659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:30.751677 7659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:30.752013 7659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:30.752452 7659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:30.752511 7659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.752574 7659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:30.752619 7659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.760432 7659 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:45161
I20260812 21:02:30.760486 7861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:45161 every 8 connection(s)
I20260812 21:02:30.760972 7659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:02:30.768116 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 7659
I20260812 21:02:30.768298 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:02:30.768545 10361 external_mini_cluster.cc:1428] Setting key 6f4c47b2978b09b5b68fc8b5d371fefb
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:30.773520 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.761922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:49545 (local address 127.10.30.126:40097)
0812 21:02:30.762008 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:30.762011 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:30.762317 (+ 306us) server_negotiation.cc:407] Connection header received
0812 21:02:30.762976 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:30.762978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:30.762992 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:30.763096 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:30.764322 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.764922 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.766110 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.766322 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.766386 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.769502 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:30.769504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:30.769505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:30.769515 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:30.771507 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.772298 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.772299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.772300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.772367 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.772699 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.772700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.772700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.772828 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:30.772884 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:30.773317 (+ 433us) server_negotiation.cc:299] Negotiation successful
0812 21:02:30.773414 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 21:02:30.773880 7865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.761901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:40097 (local address 127.10.30.66:49545)
0812 21:02:30.762133 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:30.762199 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:30.762868 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:30.763164 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:30.763168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:30.763923 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:30.764204 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.764210 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.765028 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.765029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.766002 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.766022 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.766424 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.766425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.766572 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.767314 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:30.767324 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:30.769366 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:30.771659 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:30.771669 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:30.771677 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:30.772204 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:30.772440 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:30.772441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:30.772441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:30.772629 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:30.772895 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:30.772902 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:30.773131 (+ 229us) client_negotiation.cc:769] Sending connection context
0812 21:02:30.773271 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 21:02:30.773523 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":122,"threads_started":1}
I20260812 21:02:30.774542 7862 heartbeater.cc:347] Connected to a master server at 127.10.30.126:40097
I20260812 21:02:30.774677 7862 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:30.774919 7862 heartbeater.cc:511] Master 127.10.30.126:40097 requested a full tablet report, sending...
I20260812 21:02:30.775440 7341 ts_manager.cc:194] Registered new tserver with Master: 8710c1b2a85a4d9fad7f03766b998f9c (127.10.30.66:45161)
I20260812 21:02:30.775964 7341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:49545
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 21:02:30.804260 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40097
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:30.907474 7868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:30.907789 7868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:30.907835 7868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:30.909232 7868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:30.909307 7868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:30.909359 7868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:02:30.911190 7868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:40097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:30.911507 7868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:30.911787 7868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:30.918040 7880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:30.918079 7879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:30.918123 7883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:30.918169 7868 server_base.cc:1034] running on GCE node
I20260812 21:02:30.918563 7868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:30.918888 7868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:30.920065 7868 hybrid_clock.cc:648] HybridClock initialized: now 1786568550920041 us; error 55 us; skew 500 ppm
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:30.923362 7868 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:02:30.924036 7868 webserver.cc:460] Webserver started at http://127.10.30.67:36853/ using document root <none> and password file <none>
I20260812 21:02:30.924288 7868 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:30.924340 7868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:30.924461 7868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:30.925740 7868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "8e077420646749cca5b77611df884609"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "bbb30c39b3910a4a6ea0993cd2a27834"
server_key_iv: "a45cdf2e4fd247c52e3dfdc4a7f3b861"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.926127 7868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "8e077420646749cca5b77611df884609"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "bbb30c39b3910a4a6ea0993cd2a27834"
server_key_iv: "a45cdf2e4fd247c52e3dfdc4a7f3b861"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.927910 7868 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 21:02:30.928941 7893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.929165 7868 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:30.929279 7868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "8e077420646749cca5b77611df884609"
format_stamp: "Formatted at 2026-08-12 21:02:30 on dist-test-slave-h3ft"
server_key: "bbb30c39b3910a4a6ea0993cd2a27834"
server_key_iv: "a45cdf2e4fd247c52e3dfdc4a7f3b861"
server_key_version: "encryptionkey@0"
I20260812 21:02:30.929404 7868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:30.946071 7868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:30.948932 7868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:30.949152 7868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:30.949434 7868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:30.949887 7868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:30.949966 7868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.950007 7868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:30.950050 7868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:30.959445 7868 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:36825
I20260812 21:02:30.959559 8072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:36825 every 8 connection(s)
I20260812 21:02:30.960064 7868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:02:30.962759 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 7868
I20260812 21:02:30.962888 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:02:30.963162 10361 external_mini_cluster.cc:1428] Setting key 9199261399bb2060448ab316f888521e
Aug 12 21:02:30 dist-test-slave-h3ft krb5kdc[7279](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:30.973356 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.961178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:60835 (local address 127.10.30.126:40097)
0812 21:02:30.961280 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:30.961284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:30.961490 (+ 206us) server_negotiation.cc:407] Connection header received
0812 21:02:30.962269 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:30.962271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:30.962287 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:30.962362 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:30.963991 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.964774 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.966117 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.966335 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.966457 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.969685 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:30.969689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:30.969689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:30.969699 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:30.971472 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.972094 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.972096 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.972097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.972173 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.972503 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.972505 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.972505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.972675 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:30.972759 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:30.973114 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 21:02:30.973231 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 21:02:30.973654 8077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.961096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:40097 (local address 127.10.30.67:60835)
0812 21:02:30.961331 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:30.961386 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:30.962117 (+ 731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:30.962471 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:30.962475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:30.963469 (+ 994us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:30.963875 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.963885 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.964897 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.964898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.966006 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.966010 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.966481 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.966482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.966663 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.967480 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:30.967492 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:30.969517 (+ 2025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:30.971610 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:30.971627 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:30.971631 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:30.971986 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:30.972265 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:30.972267 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:30.972267 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:30.972429 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:30.972747 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:30.972757 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:30.972948 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 21:02:30.973087 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 21:02:30.973319 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":122,"threads_started":1}
I20260812 21:02:30.974431 8073 heartbeater.cc:347] Connected to a master server at 127.10.30.126:40097
I20260812 21:02:30.974588 8073 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:30.974902 8073 heartbeater.cc:511] Master 127.10.30.126:40097 requested a full tablet report, sending...
I20260812 21:02:30.975554 7341 ts_manager.cc:194] Registered new tserver with Master: 8e077420646749cca5b77611df884609 (127.10.30.67:36825)
I20260812 21:02:30.975833 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:02:30.976110 7341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:60835
I20260812 21:02:30.985332 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.977750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.10.30.126:40097)
0812 21:02:30.977835 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:30.977838 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:30.977940 (+ 102us) server_negotiation.cc:407] Connection header received
0812 21:02:30.978028 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:30.978029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:30.978042 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:30.978098 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:30.978749 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.979345 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.980147 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.980355 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.980432 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.981896 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:30.981898 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:30.981898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:30.982037 (+ 139us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:30.983819 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.984251 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.984253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.984254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.984327 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:30.984552 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:30.984553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:30.984553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:30.984764 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:30.984885 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:30.985065 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 21:02:30.985200 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 21:02:30.987703 7341 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:02:30.989950 7341 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:02:30.998703 8092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.993203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:34813 (local address 127.0.0.1:49240)
0812 21:02:30.993667 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:30.993733 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:30.993845 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:30.994354 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:30.994355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:30.994357 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:30.994414 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.994415 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.995907 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.995908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.997095 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.997101 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.998259 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.998260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.998367 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.998388 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 21:02:30.998469 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 21:02:30.998548 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":5,"thread_start_us":102,"threads_started":1}
I20260812 21:02:30.998759 8097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.993508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49240 (local address 127.10.30.65:34813)
0812 21:02:30.994182 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:30.994187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:30.994198 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:02:30.994245 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:30.994247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:30.994263 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:30.994359 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:30.994469 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.995766 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.997225 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.998157 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.998245 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.998324 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:30.998583 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 21:02:30.998643 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":120,"threads_started":1}
I20260812 21:02:30.999349 8093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.993209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:45161 (local address 127.0.0.1:38208)
0812 21:02:30.993964 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:30.993975 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:30.994025 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:30.994279 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:30.994280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:30.994283 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:30.994357 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.994360 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.995572 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.995574 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.997117 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.997119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.999050 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.999051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.999123 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.999130 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 21:02:30.999185 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 21:02:30.999246 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":38,"thread_start_us":150,"threads_started":1}
I20260812 21:02:30.999706 8096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.993468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.10.30.67:36825)
0812 21:02:30.993878 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:30.993886 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:30.993903 (+ 17us) server_negotiation.cc:407] Connection header received
0812 21:02:30.993959 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:30.993962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:30.993987 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:30.994098 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:30.994463 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.995765 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.998081 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.998976 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.999078 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.999149 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:30.999407 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 21:02:30.999602 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":139,"threads_started":1}
I20260812 21:02:30.999706 8098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.993641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38208 (local address 127.10.30.66:45161)
0812 21:02:30.994057 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:30.994063 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:30.994074 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:02:30.994134 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:30.994137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:30.994157 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:30.994461 (+ 304us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:30.994599 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.995439 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.997225 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.998155 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.998245 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.998324 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:30.999522 (+ 1198us) server_negotiation.cc:299] Negotiation successful
0812 21:02:30.999602 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":149,"threads_started":1}
I20260812 21:02:30.999712 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:30.993203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:36825 (local address 127.0.0.1:47682)
0812 21:02:30.993765 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:30.993779 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:30.993859 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:30.994233 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:30.994237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:30.994239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:30.994357 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.994362 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.997224 (+ 2862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.997225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.997959 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:30.997960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:30.999184 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:30.999184 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:30.999259 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:30.999262 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 21:02:30.999313 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 21:02:30.999355 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"mutex_wait_us":3,"thread_start_us":121,"threads_started":1}
I20260812 21:02:30.999810 7538 tablet_service.cc:1467] Processing CreateTablet for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d (DEFAULT_TABLE table=test-table [id=be3ce3ed2eea4dc5907ce7b8d4c0dcc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:31.000353 7538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:31.000555 7764 tablet_service.cc:1467] Processing CreateTablet for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d (DEFAULT_TABLE table=test-table [id=be3ce3ed2eea4dc5907ce7b8d4c0dcc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:31.000873 7764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:31.000877 7962 tablet_service.cc:1467] Processing CreateTablet for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d (DEFAULT_TABLE table=test-table [id=be3ce3ed2eea4dc5907ce7b8d4c0dcc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:31.001293 7962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:31.004451 8099 tablet_bootstrap.cc:492] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Bootstrap starting.
I20260812 21:02:31.004834 8101 tablet_bootstrap.cc:492] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c: Bootstrap starting.
I20260812 21:02:31.005424 8103 tablet_bootstrap.cc:492] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: Bootstrap starting.
I20260812 21:02:31.005654 8101 tablet_bootstrap.cc:654] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:31.005668 8099 tablet_bootstrap.cc:654] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:31.006260 8101 log.cc:824] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:31.006311 8103 tablet_bootstrap.cc:654] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:31.006359 8099 log.cc:824] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:31.007083 8103 log.cc:824] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:31.007306 8101 tablet_bootstrap.cc:492] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c: No bootstrap required, opened a new log
I20260812 21:02:31.007376 8099 tablet_bootstrap.cc:492] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: No bootstrap required, opened a new log
I20260812 21:02:31.007377 8101 ts_tablet_manager.cc:1397] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:02:31.007440 8099 ts_tablet_manager.cc:1397] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:02:31.009055 8101 raft_consensus.cc:348] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.009054 8099 raft_consensus.cc:348] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.009231 8099 raft_consensus.cc:374] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:31.009231 8101 raft_consensus.cc:374] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:31.009258 8099 raft_consensus.cc:729] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8710c1b2a85a4d9fad7f03766b998f9c, State: Initialized, Role: FOLLOWER
I20260812 21:02:31.009258 8101 raft_consensus.cc:729] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ccf2035b1044448b55a20b78462e8c, State: Initialized, Role: FOLLOWER
I20260812 21:02:31.009377 8101 consensus_queue.cc:260] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.009410 8099 consensus_queue.cc:260] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.009677 8101 ts_tablet_manager.cc:1428] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 21:02:31.009727 7648 heartbeater.cc:503] Master 127.10.30.126:40097 was elected leader, sending a full tablet report...
I20260812 21:02:31.009773 8099 ts_tablet_manager.cc:1428] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 21:02:31.009905 7862 heartbeater.cc:503] Master 127.10.30.126:40097 was elected leader, sending a full tablet report...
I20260812 21:02:31.010929 8103 tablet_bootstrap.cc:492] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: No bootstrap required, opened a new log
I20260812 21:02:31.011061 8103 ts_tablet_manager.cc:1397] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
W20260812 21:02:31.011667 7864 tablet.cc:2369] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:02:31.013131 8103 raft_consensus.cc:348] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.013345 8103 raft_consensus.cc:374] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:31.013399 8103 raft_consensus.cc:729] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e077420646749cca5b77611df884609, State: Initialized, Role: FOLLOWER
I20260812 21:02:31.013559 8103 consensus_queue.cc:260] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.013918 8103 ts_tablet_manager.cc:1428] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 21:02:31.013990 8073 heartbeater.cc:503] Master 127.10.30.126:40097 was elected leader, sending a full tablet report...
I20260812 21:02:31.015826 8113 raft_consensus.cc:482] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:31.015966 8113 raft_consensus.cc:504] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.016429 8113 leader_election.cc:288] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ccf2035b1044448b55a20b78462e8c (127.10.30.65:34813), 8e077420646749cca5b77611df884609 (127.10.30.67:36825)
I20260812 21:02:31.020207 7865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.016669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:36825 (local address 127.10.30.66:42639)
0812 21:02:31.016752 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.016767 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.016822 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.017049 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.017050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.017053 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:31.017157 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.017160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.017880 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.017881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.018986 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.018990 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.019928 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.019929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.020027 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.020031 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.020078 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.020125 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 21:02:31.020253 8096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.016816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:42639 (local address 127.10.30.67:36825)
0812 21:02:31.016886 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.016888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.016899 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:02:31.016936 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.016937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.016950 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.017040 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:31.017255 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.017800 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.019119 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.019792 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.019866 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.019890 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.020111 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.020170 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 21:02:31.020680 7997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb06c1ce1d4d47e6a1eb3ba56e53f17d" candidate_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e077420646749cca5b77611df884609" is_pre_election: true
I20260812 21:02:31.020910 8118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.016669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:34813 (local address 127.10.30.66:45693)
0812 21:02:31.017311 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.017320 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.017401 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.017545 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.017546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.017547 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:31.017627 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.017629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.018541 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.018542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.019719 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.019723 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.020592 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.020593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.020678 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.020689 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.020760 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.020810 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":151,"thread_start_us":181,"threads_started":1}
I20260812 21:02:31.020900 8097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.016742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:45693 (local address 127.10.30.65:34813)
0812 21:02:31.016808 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.016811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.017394 (+ 583us) server_negotiation.cc:407] Connection header received
0812 21:02:31.017462 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.017464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.017480 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.017541 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:31.017707 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.018431 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.019850 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.020483 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.020591 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.020602 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.020768 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.020821 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 21:02:31.020946 7997 raft_consensus.cc:2454] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8710c1b2a85a4d9fad7f03766b998f9c in term 0.
I20260812 21:02:31.021260 7688 leader_election.cc:302] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8710c1b2a85a4d9fad7f03766b998f9c, 8e077420646749cca5b77611df884609; no voters:
I20260812 21:02:31.021273 7575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb06c1ce1d4d47e6a1eb3ba56e53f17d" candidate_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ccf2035b1044448b55a20b78462e8c" is_pre_election: true
I20260812 21:02:31.021430 7575 raft_consensus.cc:2454] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8710c1b2a85a4d9fad7f03766b998f9c in term 0.
I20260812 21:02:31.021452 8113 raft_consensus.cc:2781] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:02:31.021538 8113 raft_consensus.cc:482] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:02:31.021572 8113 raft_consensus.cc:3037] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:31.022567 8113 raft_consensus.cc:504] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.022863 8113 leader_election.cc:288] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [CANDIDATE]: Term 1 election: Requested vote from peers 75ccf2035b1044448b55a20b78462e8c (127.10.30.65:34813), 8e077420646749cca5b77611df884609 (127.10.30.67:36825)
I20260812 21:02:31.022948 7997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb06c1ce1d4d47e6a1eb3ba56e53f17d" candidate_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e077420646749cca5b77611df884609"
I20260812 21:02:31.022980 7575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb06c1ce1d4d47e6a1eb3ba56e53f17d" candidate_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ccf2035b1044448b55a20b78462e8c"
I20260812 21:02:31.023082 7997 raft_consensus.cc:3037] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:31.023160 7575 raft_consensus.cc:3037] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:31.024220 7575 raft_consensus.cc:2454] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8710c1b2a85a4d9fad7f03766b998f9c in term 1.
I20260812 21:02:31.024250 7997 raft_consensus.cc:2454] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8710c1b2a85a4d9fad7f03766b998f9c in term 1.
I20260812 21:02:31.024430 7690 leader_election.cc:302] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ccf2035b1044448b55a20b78462e8c, 8710c1b2a85a4d9fad7f03766b998f9c; no voters:
I20260812 21:02:31.024585 8113 raft_consensus.cc:2781] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:31.024827 8113 raft_consensus.cc:686] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 1 LEADER]: Becoming Leader. State: Replica: 8710c1b2a85a4d9fad7f03766b998f9c, State: Running, Role: LEADER
I20260812 21:02:31.024966 8113 consensus_queue.cc:237] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } }
I20260812 21:02:31.026196 7341 catalog_manager.cc:5495] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8710c1b2a85a4d9fad7f03766b998f9c (127.10.30.66). New cstate: current_term: 1 leader_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8710c1b2a85a4d9fad7f03766b998f9c" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 45161 } health_report { overall_health: HEALTHY } } }
I20260812 21:02:31.037501 8098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.034620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38210 (local address 127.10.30.66:45161)
0812 21:02:31.034681 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.034683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.034692 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:02:31.034743 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.034744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.034770 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.034849 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:02:31.035117 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.035646 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.036584 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.036842 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.036928 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.037088 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:02:31.037240 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:02:31.037314 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.037333 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.037361 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 21:02:31.040411 7997 raft_consensus.cc:1261] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 1 FOLLOWER]: Refusing update from remote peer 8710c1b2a85a4d9fad7f03766b998f9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:31.040411 7575 raft_consensus.cc:1261] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 75ccf2035b1044448b55a20b78462e8c [term 1 FOLLOWER]: Refusing update from remote peer 8710c1b2a85a4d9fad7f03766b998f9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:31.040930 8113 consensus_queue.cc:1035] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ccf2035b1044448b55a20b78462e8c" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 34813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:31.041152 8122 consensus_queue.cc:1035] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e077420646749cca5b77611df884609" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:31.044873 8126 mvcc.cc:205] Tried to move back new op lower bound from 7317784785057247232 to 7317784784998989824. Current Snapshot: MvccSnapshot[applied={T|T < 7317784785057247232}]
I20260812 21:02:31.045334 8130 mvcc.cc:205] Tried to move back new op lower bound from 7317784785057247232 to 7317784784998989824. Current Snapshot: MvccSnapshot[applied={T|T < 7317784785057247232}]
I20260812 21:02:31.048108 7338 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:31.048250 7338 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:31.049403 7338 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f9e32a09e59462e85f65fe629d8cadf: Sending DeleteTablet for 3 replicas of tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d
I20260812 21:02:31.049877 7764 tablet_service.cc:1514] Processing DeleteTablet for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:31 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:38208
I20260812 21:02:31.049938 7962 tablet_service.cc:1514] Processing DeleteTablet for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:31 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:47682
I20260812 21:02:31.049934 7538 tablet_service.cc:1514] Processing DeleteTablet for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:31 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:49240
I20260812 21:02:31.050598 8146 tablet_replica.cc:330] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: stopping tablet replica
I20260812 21:02:31.050640 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 7447
I20260812 21:02:31.050838 8146 raft_consensus.cc:2229] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:02:31.051028 8146 raft_consensus.cc:2258] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:31.055747 8147 tablet_replica.cc:330] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: stopping tablet replica
I20260812 21:02:31.056321 8146 ts_tablet_manager.cc:1905] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:31.058697 8146 ts_tablet_manager.cc:1918] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:31.058797 8146 log.cc:1196] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/cb06c1ce1d4d47e6a1eb3ba56e53f17d
I20260812 21:02:31.059238 8146 ts_tablet_manager.cc:1939] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8e077420646749cca5b77611df884609: Deleting consensus metadata
I20260812 21:02:31.062392 8147 raft_consensus.cc:2229] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:02:31.062655 8147 raft_consensus.cc:2258] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:31.072341 8147 ts_tablet_manager.cc:1905] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:31.076114 8147 ts_tablet_manager.cc:1918] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:31.076292 8147 log.cc:1196] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/cb06c1ce1d4d47e6a1eb3ba56e53f17d
I20260812 21:02:31.076800 8147 ts_tablet_manager.cc:1939] T cb06c1ce1d4d47e6a1eb3ba56e53f17d P 8710c1b2a85a4d9fad7f03766b998f9c: Deleting consensus metadata
I20260812 21:02:31.079447 7322 catalog_manager.cc:4841] TS 8e077420646749cca5b77611df884609 (127.10.30.67:36825): tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d (table test-table [id=be3ce3ed2eea4dc5907ce7b8d4c0dcc7]) successfully deleted
I20260812 21:02:31.079937 7320 catalog_manager.cc:4841] TS 8710c1b2a85a4d9fad7f03766b998f9c (127.10.30.66:45161): tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d (table test-table [id=be3ce3ed2eea4dc5907ce7b8d4c0dcc7]) successfully deleted
W20260812 21:02:31.096369 7324 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:34813 (error 108)
I20260812 21:02:31.097313 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.097108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:34813 (local address 127.0.0.1:49246)
0812 21:02:31.097196 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.097252 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:34813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 21:02:31.097503 7324 catalog_manager.cc:4584] TS 75ccf2035b1044448b55a20b78462e8c (127.10.30.65:34813): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cb06c1ce1d4d47e6a1eb3ba56e53f17d: Network error: Client connection negotiation failed: client connection to 127.10.30.65:34813: connect: Connection refused (error 111)
I20260812 21:02:31.098137 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 7659
I20260812 21:02:31.137797 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 7868
I20260812 21:02:31.151067 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.150767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:34813 (local address 127.0.0.1:49258)
0812 21:02:31.150893 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.150952 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:34813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 21:02:31.153867 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.153666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:34813 (local address 127.0.0.1:49270)
0812 21:02:31.153750 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.153804 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:34813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 21:02:31.160362 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 7298
2026-08-12T21:02:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2590 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T21:02:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:31Z Disabled control of system clock
I20260812 21:02:31.232954 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:36875
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:36875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:31.347697 8157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:31.348109 8157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:31.348141 8157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:31.350296 8157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:31.350417 8157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:31.350431 8157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:31.350446 8157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:31.350459 8157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:31.352607 8157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:36875
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:36875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:31.352988 8157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:31.353377 8157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:31.359819 8167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:31.359943 8157 server_base.cc:1034] running on GCE node
W20260812 21:02:31.359849 8165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:31.359822 8164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:31.360558 8157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:31.360944 8157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:31.362150 8157 hybrid_clock.cc:648] HybridClock initialized: now 1786568551362130 us; error 46 us; skew 500 ppm
I20260812 21:02:31.363847 8157 webserver.cc:460] Webserver started at http://127.10.30.126:41329/ using document root <none> and password file <none>
I20260812 21:02:31.364223 8157 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:31.364281 8157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:31.364499 8157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:31.365882 8157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "57f99f170ad80dc7dd75d89d50369c58"
server_key_iv: "f2a1d303899356111c515a3c769db7d9"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.366333 8157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "57f99f170ad80dc7dd75d89d50369c58"
server_key_iv: "f2a1d303899356111c515a3c769db7d9"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.368096 8157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260812 21:02:31.369349 8177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.369711 8157 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:31.369865 8157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "57f99f170ad80dc7dd75d89d50369c58"
server_key_iv: "f2a1d303899356111c515a3c769db7d9"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.370016 8157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:31.389881 8157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:31.390359 8157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:31.390574 8157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:31.395615 8157 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:36875
I20260812 21:02:31.395671 8257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:36875 every 8 connection(s)
I20260812 21:02:31.396123 8157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:31.397496 8258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:31.401218 8258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf: Bootstrap starting.
I20260812 21:02:31.402195 8258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:31.402531 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 8157
I20260812 21:02:31.402658 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:31.402681 8258 log.cc:824] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:31.402927 10361 external_mini_cluster.cc:1428] Setting key 7dd3b53d20f227edf75ff2b77a1cb672
I20260812 21:02:31.403831 8258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf: No bootstrap required, opened a new log
I20260812 21:02:31.407079 8258 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36875 } }
I20260812 21:02:31.407310 8258 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:31.407354 8258 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb79a4a5768d4f5ca4ca84c9df97f2cf, State: Initialized, Role: FOLLOWER
I20260812 21:02:31.407542 8258 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36875 } }
I20260812 21:02:31.407640 8258 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:31.407677 8258 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:31.407728 8258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:31.408632 8258 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36875 } }
I20260812 21:02:31.408735 8258 leader_election.cc:302] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb79a4a5768d4f5ca4ca84c9df97f2cf; no voters:
I20260812 21:02:31.408979 8258 leader_election.cc:288] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:31.409080 8265 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:31.409255 8265 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [term 1 LEADER]: Becoming Leader. State: Replica: cb79a4a5768d4f5ca4ca84c9df97f2cf, State: Running, Role: LEADER
I20260812 21:02:31.409313 8258 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:31.409348 8265 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36875 } }
I20260812 21:02:31.409765 8265 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb79a4a5768d4f5ca4ca84c9df97f2cf. Latest consensus state: current_term: 1 leader_uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36875 } } }
I20260812 21:02:31.409866 8265 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:31.409780 8266 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb79a4a5768d4f5ca4ca84c9df97f2cf" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36875 } } }
I20260812 21:02:31.410025 8266 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:31.410200 8271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:31.410844 8264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.403656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43188 (local address 127.10.30.126:36875)
0812 21:02:31.403890 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.403902 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.404593 (+ 691us) server_negotiation.cc:407] Connection header received
0812 21:02:31.405519 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.405530 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.405609 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.405755 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:31.406069 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.407143 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.408238 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.408713 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.408854 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.409865 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:31.409871 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:31.409872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:31.410157 (+ 285us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:31.410214 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:31.410233 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:31.410287 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.410439 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.410558 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260812 21:02:31.411441 8271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:31.413601 8271 catalog_manager.cc:1347] Generated new cluster ID: ad93d49e8b4844a5ba80ea5caa20dd36
I20260812 21:02:31.413686 8271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:31.430271 8271 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:31.430938 8271 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:31.437009 8271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf: Generated new TSK 0
I20260812 21:02:31.437278 8271 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:31.444510 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36875
--builtin_ntp_servers=127.10.30.84:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:31.560497 8295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:31.560809 8295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:31.560851 8295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:31.562188 8295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:31.562258 8295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:31.562302 8295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:02:31.563917 8295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:31.564252 8295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:31.564642 8295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:31.570711 8303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:31.570699 8307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:31.570699 8302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:31.570806 8295 server_base.cc:1034] running on GCE node
I20260812 21:02:31.571331 8295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:31.571643 8295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:31.572847 8295 hybrid_clock.cc:648] HybridClock initialized: now 1786568551572824 us; error 46 us; skew 500 ppm
I20260812 21:02:31.574692 8295 webserver.cc:460] Webserver started at http://127.10.30.65:39187/ using document root <none> and password file <none>
I20260812 21:02:31.575042 8295 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:31.575127 8295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:31.575291 8295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:31.576610 8295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "bf1d105303414cb883a5db7401647160"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "9c41059e457bc93ec82538adf26368e1"
server_key_iv: "997a3286b35b54c3662eba846ae0860c"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.577040 8295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "bf1d105303414cb883a5db7401647160"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "9c41059e457bc93ec82538adf26368e1"
server_key_iv: "997a3286b35b54c3662eba846ae0860c"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.578649 8295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 21:02:31.579605 8315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.579763 8295 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 21:02:31.579893 8295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "bf1d105303414cb883a5db7401647160"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "9c41059e457bc93ec82538adf26368e1"
server_key_iv: "997a3286b35b54c3662eba846ae0860c"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.579984 8295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:31.593868 8295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:31.594319 8295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:31.594498 8295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:31.594798 8295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:31.595274 8295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:31.595315 8295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.595361 8295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:31.595387 8295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.603199 8295 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:42001
I20260812 21:02:31.603291 8501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:42001 every 8 connection(s)
I20260812 21:02:31.603790 8295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:02:31.610512 8264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.604868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:34549 (local address 127.10.30.126:36875)
0812 21:02:31.604947 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.604949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.605220 (+ 271us) server_negotiation.cc:407] Connection header received
0812 21:02:31.605838 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.605839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.605858 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.605927 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:31.606726 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.607363 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.608490 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.608712 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.608841 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.610097 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:31.610099 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:31.610100 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:31.610106 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:31.610125 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:31.610130 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:31.610207 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.610359 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.610414 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 21:02:31.610888 8505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.604742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36875 (local address 127.10.30.65:34549)
0812 21:02:31.605075 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.605120 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.605743 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.605992 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.605996 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.606005 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:31.606638 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.606642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.607456 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.607458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.608394 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.608397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.608857 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.608858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.608997 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.609848 (+ 851us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:31.609849 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:31.609901 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:31.609941 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:31.610225 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:31.610235 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:31.610239 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.610319 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.610463 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":127,"threads_started":1}
I20260812 21:02:31.611531 8503 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36875
I20260812 21:02:31.611650 8503 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:31.611852 8503 heartbeater.cc:511] Master 127.10.30.126:36875 requested a full tablet report, sending...
I20260812 21:02:31.612483 8202 ts_manager.cc:194] Registered new tserver with Master: bf1d105303414cb883a5db7401647160 (127.10.30.65:42001)
I20260812 21:02:31.613184 8202 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.65:34549
I20260812 21:02:31.614079 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 8295
I20260812 21:02:31.614218 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:02:31.614444 10361 external_mini_cluster.cc:1428] Setting key b66b2fb46f51e314e20f1287d84942cb
I20260812 21:02:31.615664 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36875
--builtin_ntp_servers=127.10.30.84:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:31.719734 8507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:31.720062 8507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:31.720093 8507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:31.721622 8507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:31.721701 8507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:31.721735 8507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:02:31.723560 8507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:31.724046 8507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:31.724612 8507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:31.731731 8523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:31.732208 8522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:31.732242 8525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:31.732290 8507 server_base.cc:1034] running on GCE node
I20260812 21:02:31.732722 8507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:31.733081 8507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:31.734313 8507 hybrid_clock.cc:648] HybridClock initialized: now 1786568551734292 us; error 47 us; skew 500 ppm
I20260812 21:02:31.736380 8507 webserver.cc:460] Webserver started at http://127.10.30.66:45239/ using document root <none> and password file <none>
I20260812 21:02:31.736732 8507 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:31.736819 8507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:31.736995 8507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:31.738351 8507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "4725c167df484de1b577179705848db8"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "e4c3aade89b9ad3aed06cf068be37984"
server_key_iv: "71c1933cdde3ea2d455f6379b7e99f68"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.738782 8507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "4725c167df484de1b577179705848db8"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "e4c3aade89b9ad3aed06cf068be37984"
server_key_iv: "71c1933cdde3ea2d455f6379b7e99f68"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.740582 8507 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260812 21:02:31.741696 8534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.741963 8507 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:31.742129 8507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "4725c167df484de1b577179705848db8"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "e4c3aade89b9ad3aed06cf068be37984"
server_key_iv: "71c1933cdde3ea2d455f6379b7e99f68"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.742235 8507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:31.762972 8507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:31.763608 8507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:31.763789 8507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:31.764166 8507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:31.764600 8507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:31.764657 8507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.764714 8507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:31.764743 8507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.772473 8507 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:42305
I20260812 21:02:31.772552 8714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:42305 every 8 connection(s)
I20260812 21:02:31.773047 8507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:02:31.773507 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 8507
I20260812 21:02:31.773648 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:02:31.773942 10361 external_mini_cluster.cc:1428] Setting key cee980f4a3938710c72ce52ca1c953ae
I20260812 21:02:31.775349 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36875
--builtin_ntp_servers=127.10.30.84:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 21:02:31.780593 8264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.774048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:41731 (local address 127.10.30.126:36875)
0812 21:02:31.774137 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.774140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.774724 (+ 584us) server_negotiation.cc:407] Connection header received
0812 21:02:31.775389 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.775391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.775407 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.775500 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:31.776729 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.777277 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.778560 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.778893 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.778992 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.780212 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:31.780214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:31.780214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:31.780223 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:31.780248 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:31.780254 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:31.780319 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.780410 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.780451 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 21:02:31.780885 8717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.774081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36875 (local address 127.10.30.66:41731)
0812 21:02:31.774475 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.774518 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.775274 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.775673 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.775679 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.775691 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:31.776581 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.776590 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.777387 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.777388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.778444 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.778448 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.779046 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.779047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.779200 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.780024 (+ 824us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:31.780025 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:31.780065 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:31.780100 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:31.780328 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:31.780333 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:31.780336 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.780397 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.780513 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":120,"threads_started":1}
I20260812 21:02:31.781651 8715 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36875
I20260812 21:02:31.781814 8715 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:31.782088 8715 heartbeater.cc:511] Master 127.10.30.126:36875 requested a full tablet report, sending...
I20260812 21:02:31.782605 8202 ts_manager.cc:194] Registered new tserver with Master: 4725c167df484de1b577179705848db8 (127.10.30.66:42305)
I20260812 21:02:31.783141 8202 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.66:41731
W20260812 21:02:31.885452 8718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:31.885854 8718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:31.885887 8718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:31.887470 8718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:31.887530 8718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:31.887562 8718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:02:31.889305 8718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:31.889653 8718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:31.890069 8718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:31.896298 8728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:31.896333 8724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:31.896301 8726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:31.896607 8718 server_base.cc:1034] running on GCE node
I20260812 21:02:31.896878 8718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:31.897269 8718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:31.898453 8718 hybrid_clock.cc:648] HybridClock initialized: now 1786568551898437 us; error 39 us; skew 500 ppm
I20260812 21:02:31.900357 8718 webserver.cc:460] Webserver started at http://127.10.30.67:37135/ using document root <none> and password file <none>
I20260812 21:02:31.900663 8718 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:31.900744 8718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:31.900918 8718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:31.902298 8718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "24710947bc0e4ff5a3f556f00a142577"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "982d7dff15424a05de77a197496002b9"
server_key_iv: "faa82ef2993eb412e6e5de8c138fec4a"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.902761 8718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "24710947bc0e4ff5a3f556f00a142577"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "982d7dff15424a05de77a197496002b9"
server_key_iv: "faa82ef2993eb412e6e5de8c138fec4a"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.904744 8718 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 21:02:31.905797 8743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.906064 8718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:31.906180 8718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "24710947bc0e4ff5a3f556f00a142577"
format_stamp: "Formatted at 2026-08-12 21:02:31 on dist-test-slave-h3ft"
server_key: "982d7dff15424a05de77a197496002b9"
server_key_iv: "faa82ef2993eb412e6e5de8c138fec4a"
server_key_version: "encryptionkey@0"
I20260812 21:02:31.906262 8718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:31.922821 8718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:31.923322 8718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:31.923471 8718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:31.923751 8718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:31.924158 8718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:31.924194 8718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.924221 8718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:31.924234 8718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:31.932719 8718 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:32909
I20260812 21:02:31.932807 8926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:32909 every 8 connection(s)
I20260812 21:02:31.933272 8718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:02:31.935184 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 8718
I20260812 21:02:31.935314 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:02:31.935557 10361 external_mini_cluster.cc:1428] Setting key b20757d53f68602ff45d8bbd634a2893
I20260812 21:02:31.940353 8264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.934442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:45287 (local address 127.10.30.126:36875)
0812 21:02:31.934554 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.934557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.934875 (+ 318us) server_negotiation.cc:407] Connection header received
0812 21:02:31.935830 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.935832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.935851 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.935922 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:31.936994 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.937559 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.938681 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.938898 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.938988 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.940001 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:31.940003 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:31.940003 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:31.940010 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:31.940038 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:31.940043 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:31.940113 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.940213 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.940250 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 21:02:31.940662 8932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.934367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36875 (local address 127.10.30.67:45287)
0812 21:02:31.934696 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.934738 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.935640 (+ 902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.936018 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.936023 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.936040 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:31.936882 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.936891 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.937684 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.937686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.938583 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.938586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.939029 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.939031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.939199 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.939828 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:31.939829 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:31.939864 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:31.939894 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:31.940116 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:31.940124 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:31.940128 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.940217 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.940358 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":209,"threads_started":1}
I20260812 21:02:31.941309 8928 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36875
I20260812 21:02:31.941433 8928 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:31.941692 8928 heartbeater.cc:511] Master 127.10.30.126:36875 requested a full tablet report, sending...
I20260812 21:02:31.942188 8202 ts_manager.cc:194] Registered new tserver with Master: 24710947bc0e4ff5a3f556f00a142577 (127.10.30.67:32909)
I20260812 21:02:31.942613 8202 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.67:45287
I20260812 21:02:31.948055 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:02:31.953235 8264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.949866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43196 (local address 127.10.30.126:36875)
0812 21:02:31.949945 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.949947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.950116 (+ 169us) server_negotiation.cc:407] Connection header received
0812 21:02:31.950157 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.950158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.950172 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.950220 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:31.950400 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.950972 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.951896 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.952134 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.952211 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.952981 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:31.952983 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:31.952983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:31.952989 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:31.953008 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:31.953013 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:31.953064 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.953124 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.953153 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 21:02:31.955161 8202 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:02:31.957474 8202 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:02:31.965723 8950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.960667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:32909 (local address 127.0.0.1:51590)
0812 21:02:31.960888 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.961225 (+ 337us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.961275 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.961643 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.961646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.961649 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:31.961749 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.961752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.963198 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.963199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.964263 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.964265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.965287 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.965288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.965397 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.965409 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.965464 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.965601 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":55,"thread_start_us":130,"threads_started":1}
I20260812 21:02:31.965840 8959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.960992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51590 (local address 127.10.30.67:32909)
0812 21:02:31.961404 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.961411 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.961425 (+ 14us) server_negotiation.cc:407] Connection header received
0812 21:02:31.961485 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.961488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.961507 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.961835 (+ 328us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:31.961920 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.963097 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.964346 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.965177 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.965515 (+ 338us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.965656 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.965687 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.965739 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":143,"threads_started":1}
I20260812 21:02:31.966065 8948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.960674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:42001 (local address 127.0.0.1:43376)
0812 21:02:31.961071 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.961113 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.961199 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.961745 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.961746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.961748 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:31.961801 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.961804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.962784 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.962785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.964214 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.964217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.965286 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.965288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.965389 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.965409 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.965464 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.965587 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":27,"thread_start_us":74,"threads_started":1}
I20260812 21:02:31.966418 8961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.961226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49614 (local address 127.10.30.66:42305)
0812 21:02:31.961444 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.961448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.961458 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:02:31.961505 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.961507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.961521 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.961615 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:31.961853 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.963098 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.965262 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.966008 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.966084 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.966173 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.966247 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.966300 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":121,"threads_started":1}
I20260812 21:02:31.966450 8953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.960816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43376 (local address 127.10.30.65:42001)
0812 21:02:31.961524 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.961530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.961543 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:02:31.961590 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.961592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.961610 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.961742 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:31.961888 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.962689 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.964317 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.965171 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.966144 (+ 973us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.966267 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.966295 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.966347 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":117,"threads_started":1}
I20260812 21:02:31.966346 8956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.960943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:42305 (local address 127.0.0.1:49614)
0812 21:02:31.961104 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.961117 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.961199 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.961707 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.961708 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.961710 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:31.961766 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.961768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.964365 (+ 2597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.964366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.965168 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.965170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.966100 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.966101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.966168 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.966173 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.966232 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.966282 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":5,"thread_start_us":96,"threads_started":1}
I20260812 21:02:31.967228 8831 tablet_service.cc:1467] Processing CreateTablet for tablet 7cb2371b718e48fc81a8e970034dce29 (DEFAULT_TABLE table=test-table [id=31ccb55b96314c7da5a283ca456f75e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:31.967686 8831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cb2371b718e48fc81a8e970034dce29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:31.967566 8403 tablet_service.cc:1467] Processing CreateTablet for tablet 7cb2371b718e48fc81a8e970034dce29 (DEFAULT_TABLE table=test-table [id=31ccb55b96314c7da5a283ca456f75e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:31.967702 8620 tablet_service.cc:1467] Processing CreateTablet for tablet 7cb2371b718e48fc81a8e970034dce29 (DEFAULT_TABLE table=test-table [id=31ccb55b96314c7da5a283ca456f75e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:31.967974 8403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cb2371b718e48fc81a8e970034dce29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:31.968055 8620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cb2371b718e48fc81a8e970034dce29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:31.971216 8963 tablet_bootstrap.cc:492] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: Bootstrap starting.
I20260812 21:02:31.971921 8964 tablet_bootstrap.cc:492] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: Bootstrap starting.
I20260812 21:02:31.972282 8963 tablet_bootstrap.cc:654] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:31.972738 8964 tablet_bootstrap.cc:654] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:31.972764 8963 log.cc:824] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:31.973161 8964 log.cc:824] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:31.973214 8965 tablet_bootstrap.cc:492] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160: Bootstrap starting.
I20260812 21:02:31.973961 8965 tablet_bootstrap.cc:654] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:31.973974 8963 tablet_bootstrap.cc:492] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: No bootstrap required, opened a new log
I20260812 21:02:31.974062 8963 ts_tablet_manager.cc:1397] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 21:02:31.974089 8964 tablet_bootstrap.cc:492] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: No bootstrap required, opened a new log
I20260812 21:02:31.974184 8964 ts_tablet_manager.cc:1397] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 21:02:31.974363 8965 log.cc:824] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:31.975194 8965 tablet_bootstrap.cc:492] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160: No bootstrap required, opened a new log
I20260812 21:02:31.975282 8965 ts_tablet_manager.cc:1397] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 21:02:31.977560 8965 raft_consensus.cc:348] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:31.977543 8964 raft_consensus.cc:348] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:31.977543 8963 raft_consensus.cc:348] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:31.977748 8963 raft_consensus.cc:374] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:31.977748 8964 raft_consensus.cc:374] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:31.977748 8965 raft_consensus.cc:374] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:31.977803 8965 raft_consensus.cc:729] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf1d105303414cb883a5db7401647160, State: Initialized, Role: FOLLOWER
I20260812 21:02:31.977803 8963 raft_consensus.cc:729] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24710947bc0e4ff5a3f556f00a142577, State: Initialized, Role: FOLLOWER
I20260812 21:02:31.977803 8964 raft_consensus.cc:729] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4725c167df484de1b577179705848db8, State: Initialized, Role: FOLLOWER
I20260812 21:02:31.977963 8964 consensus_queue.cc:260] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:31.977959 8963 consensus_queue.cc:260] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:31.978004 8965 consensus_queue.cc:260] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:31.978322 8963 ts_tablet_manager.cc:1428] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: Time spent starting tablet: real 0.004s user 0.000s sys 0.005s
I20260812 21:02:31.978323 8964 ts_tablet_manager.cc:1428] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 21:02:31.978327 8965 ts_tablet_manager.cc:1428] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:02:31.978369 8503 heartbeater.cc:503] Master 127.10.30.126:36875 was elected leader, sending a full tablet report...
I20260812 21:02:31.978473 8715 heartbeater.cc:503] Master 127.10.30.126:36875 was elected leader, sending a full tablet report...
I20260812 21:02:31.978854 8928 heartbeater.cc:503] Master 127.10.30.126:36875 was elected leader, sending a full tablet report...
I20260812 21:02:31.993480 8970 raft_consensus.cc:482] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:31.993686 8970 raft_consensus.cc:504] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:31.994282 8970 leader_election.cc:288] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf1d105303414cb883a5db7401647160 (127.10.30.65:42001), 4725c167df484de1b577179705848db8 (127.10.30.66:42305)
I20260812 21:02:31.997922 8961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.994618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:34293 (local address 127.10.30.66:42305)
0812 21:02:31.994673 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.994676 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.994689 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:02:31.994761 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.994762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.994780 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.994865 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:31.995113 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.995650 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.996804 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.997424 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.997519 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.997533 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.997769 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.997828 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 21:02:31.997937 8953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.994634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:41685 (local address 127.10.30.65:42001)
0812 21:02:31.994704 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:31.994706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:31.994912 (+ 206us) server_negotiation.cc:407] Connection header received
0812 21:02:31.995022 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:31.995023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:31.995041 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:31.995120 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:31.995290 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.995783 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.996919 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.997515 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.997587 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.997597 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:31.997806 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 21:02:31.997869 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 21:02:31.997956 8932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.994538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:42305 (local address 127.10.30.67:34293)
0812 21:02:31.994616 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.994631 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.994689 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.994876 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.994877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.994879 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:31.994973 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.994975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.995744 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.995746 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.996714 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.996718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.997533 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.997534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.997664 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.997670 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.997742 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.997812 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":2}
I20260812 21:02:31.998245 8974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:31.994567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:42001 (local address 127.10.30.67:41685)
0812 21:02:31.994821 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:31.994830 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:31.994926 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:31.995123 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:31.995124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:31.995125 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:31.995215 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.995217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.995920 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.995921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.996813 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:31.996816 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:31.997602 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:31.997603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:31.997693 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:31.997696 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 21:02:31.997787 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 21:02:31.997828 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":4,"thread_start_us":189,"threads_started":1}
I20260812 21:02:31.998539 8646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cb2371b718e48fc81a8e970034dce29" candidate_uuid: "24710947bc0e4ff5a3f556f00a142577" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4725c167df484de1b577179705848db8" is_pre_election: true
I20260812 21:02:31.998689 8435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cb2371b718e48fc81a8e970034dce29" candidate_uuid: "24710947bc0e4ff5a3f556f00a142577" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf1d105303414cb883a5db7401647160" is_pre_election: true
I20260812 21:02:31.998759 8646 raft_consensus.cc:2454] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24710947bc0e4ff5a3f556f00a142577 in term 0.
I20260812 21:02:31.998898 8435 raft_consensus.cc:2454] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24710947bc0e4ff5a3f556f00a142577 in term 0.
I20260812 21:02:31.999086 8745 leader_election.cc:302] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24710947bc0e4ff5a3f556f00a142577, 4725c167df484de1b577179705848db8; no voters:
I20260812 21:02:31.999259 8970 raft_consensus.cc:2781] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:02:31.999346 8970 raft_consensus.cc:482] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:02:31.999380 8970 raft_consensus.cc:3037] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:32.000360 8970 raft_consensus.cc:504] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:32.000543 8970 leader_election.cc:288] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [CANDIDATE]: Term 1 election: Requested vote from peers bf1d105303414cb883a5db7401647160 (127.10.30.65:42001), 4725c167df484de1b577179705848db8 (127.10.30.66:42305)
I20260812 21:02:32.000743 8435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cb2371b718e48fc81a8e970034dce29" candidate_uuid: "24710947bc0e4ff5a3f556f00a142577" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf1d105303414cb883a5db7401647160"
I20260812 21:02:32.000847 8435 raft_consensus.cc:3037] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:32.001792 8435 raft_consensus.cc:2454] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24710947bc0e4ff5a3f556f00a142577 in term 1.
I20260812 21:02:32.001987 8646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cb2371b718e48fc81a8e970034dce29" candidate_uuid: "24710947bc0e4ff5a3f556f00a142577" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4725c167df484de1b577179705848db8"
I20260812 21:02:32.002034 8744 leader_election.cc:302] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24710947bc0e4ff5a3f556f00a142577, bf1d105303414cb883a5db7401647160; no voters:
I20260812 21:02:32.002166 8970 raft_consensus.cc:2781] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:32.002126 8646 raft_consensus.cc:3037] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:32.002430 8970 raft_consensus.cc:686] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 1 LEADER]: Becoming Leader. State: Replica: 24710947bc0e4ff5a3f556f00a142577, State: Running, Role: LEADER
I20260812 21:02:32.002580 8970 consensus_queue.cc:237] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } }
I20260812 21:02:32.003356 8646 raft_consensus.cc:2454] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24710947bc0e4ff5a3f556f00a142577 in term 1.
I20260812 21:02:32.003937 8197 catalog_manager.cc:5495] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24710947bc0e4ff5a3f556f00a142577 (127.10.30.67). New cstate: current_term: 1 leader_uuid: "24710947bc0e4ff5a3f556f00a142577" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24710947bc0e4ff5a3f556f00a142577" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 32909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 } health_report { overall_health: UNKNOWN } } }
I20260812 21:02:32.013689 8959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:32.010808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51600 (local address 127.10.30.67:32909)
0812 21:02:32.010870 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:32.010872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:32.010904 (+ 32us) server_negotiation.cc:407] Connection header received
0812 21:02:32.011031 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:32.011032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:32.011062 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:32.011162 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:02:32.011345 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:32.011875 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:32.012745 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:32.012967 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:32.013040 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:32.013225 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:02:32.013377 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:02:32.013481 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:32.013499 (+ 18us) server_negotiation.cc:299] Negotiation successful
0812 21:02:32.013528 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 21:02:32.016285 8435 raft_consensus.cc:1261] T 7cb2371b718e48fc81a8e970034dce29 P bf1d105303414cb883a5db7401647160 [term 1 FOLLOWER]: Refusing update from remote peer 24710947bc0e4ff5a3f556f00a142577: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:32.016286 8646 raft_consensus.cc:1261] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 1 FOLLOWER]: Refusing update from remote peer 24710947bc0e4ff5a3f556f00a142577: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:32.016832 8970 consensus_queue.cc:1035] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4725c167df484de1b577179705848db8" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 42305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:32.017210 8975 consensus_queue.cc:1035] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf1d105303414cb883a5db7401647160" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:32.020589 8981 mvcc.cc:205] Tried to move back new op lower bound from 7317784789054992384 to 7317784789003669504. Current Snapshot: MvccSnapshot[applied={T|T < 7317784789054992384}]
I20260812 21:02:32.024245 8198 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:32.024384 8198 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:32.025427 8198 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb79a4a5768d4f5ca4ca84c9df97f2cf: Sending DeleteTablet for 3 replicas of tablet 7cb2371b718e48fc81a8e970034dce29
I20260812 21:02:32.025892 8620 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cb2371b718e48fc81a8e970034dce29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:49614
I20260812 21:02:32.025880 8831 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cb2371b718e48fc81a8e970034dce29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:51590
I20260812 21:02:32.025935 8403 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cb2371b718e48fc81a8e970034dce29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:43376
I20260812 21:02:32.026235 8994 tablet_replica.cc:330] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: stopping tablet replica
I20260812 21:02:32.026305 8995 tablet_replica.cc:330] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: stopping tablet replica
I20260812 21:02:32.026376 8994 raft_consensus.cc:2229] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:02:32.026408 8995 raft_consensus.cc:2229] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:02:32.026517 8994 raft_consensus.cc:2258] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:32.026543 8995 raft_consensus.cc:2258] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:32.026932 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 8295
I20260812 21:02:32.027127 8995 ts_tablet_manager.cc:1905] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:32.038463 8995 ts_tablet_manager.cc:1918] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:32.038632 8995 log.cc:1196] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/7cb2371b718e48fc81a8e970034dce29
I20260812 21:02:32.038756 8994 ts_tablet_manager.cc:1905] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:32.039045 8995 ts_tablet_manager.cc:1939] T 7cb2371b718e48fc81a8e970034dce29 P 4725c167df484de1b577179705848db8: Deleting consensus metadata
I20260812 21:02:32.039767 8181 catalog_manager.cc:4841] TS 4725c167df484de1b577179705848db8 (127.10.30.66:42305): tablet 7cb2371b718e48fc81a8e970034dce29 (table test-table [id=31ccb55b96314c7da5a283ca456f75e9]) successfully deleted
I20260812 21:02:32.040936 8994 ts_tablet_manager.cc:1918] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:32.041064 8994 log.cc:1196] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/7cb2371b718e48fc81a8e970034dce29
I20260812 21:02:32.041433 8994 ts_tablet_manager.cc:1939] T 7cb2371b718e48fc81a8e970034dce29 P 24710947bc0e4ff5a3f556f00a142577: Deleting consensus metadata
I20260812 21:02:32.042120 8183 catalog_manager.cc:4841] TS 24710947bc0e4ff5a3f556f00a142577 (127.10.30.67:32909): tablet 7cb2371b718e48fc81a8e970034dce29 (table test-table [id=31ccb55b96314c7da5a283ca456f75e9]) successfully deleted
W20260812 21:02:32.054131 8179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:42001 (error 108)
I20260812 21:02:32.055186 8956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:32.054858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:42001 (local address 127.0.0.1:43384)
0812 21:02:32.054978 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:32.055122 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:42001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 21:02:32.055384 8179 catalog_manager.cc:4584] TS bf1d105303414cb883a5db7401647160 (127.10.30.65:42001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7cb2371b718e48fc81a8e970034dce29: Network error: Client connection negotiation failed: client connection to 127.10.30.65:42001: connect: Connection refused (error 111)
I20260812 21:02:32.056036 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 8507
I20260812 21:02:32.079303 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 8718
I20260812 21:02:32.094856 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 8157
2026-08-12T21:02:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (920 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:32 dist-test-slave-h3ft krb5kdc[9004](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:32 dist-test-slave-h3ft krb5kdc[9004](info): set up 2 sockets
Aug 12 21:02:32 dist-test-slave-h3ft krb5kdc[9004](info): commencing operation
krb5kdc: starting...
W20260812 21:02:33.497215 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.364s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:33 dist-test-slave-h3ft krb5kdc[9004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:02:33.655079 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:34505
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:34505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:33.759858 9028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:33.760227 9028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:33.760272 9028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:33.761755 9028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:33.761833 9028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:33.761857 9028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:33.761897 9028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:33.761927 9028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:33.763865 9028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:34505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:34505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:33.764254 9028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:33.764551 9028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:33.770419 9041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:33.770411 9037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:33.770419 9038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:33.770757 9028 server_base.cc:1034] running on GCE node
I20260812 21:02:33.771154 9028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:33.771478 9028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:33.772666 9028 hybrid_clock.cc:648] HybridClock initialized: now 1786568553772651 us; error 33 us; skew 500 ppm
Aug 12 21:02:33 dist-test-slave-h3ft krb5kdc[9004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568553, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:33.781339 9028 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:02:33.782052 9028 webserver.cc:460] Webserver started at http://127.10.30.126:42979/ using document root <none> and password file <none>
I20260812 21:02:33.782328 9028 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:33.782410 9028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:33.782578 9028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:33.784022 9028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "9d94a7f7f1124a2487b20db9711e13b4"
format_stamp: "Formatted at 2026-08-12 21:02:33 on dist-test-slave-h3ft"
server_key: "912ef6cfc11af6d0181773184a0c3849"
server_key_iv: "e1a12b4eb9021d57ba6d4e8ab9681766"
server_key_version: "encryptionkey@0"
I20260812 21:02:33.784502 9028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "9d94a7f7f1124a2487b20db9711e13b4"
format_stamp: "Formatted at 2026-08-12 21:02:33 on dist-test-slave-h3ft"
server_key: "912ef6cfc11af6d0181773184a0c3849"
server_key_iv: "e1a12b4eb9021d57ba6d4e8ab9681766"
server_key_version: "encryptionkey@0"
I20260812 21:02:33.786232 9028 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 21:02:33.787422 9055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:33.787663 9028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:33.787814 9028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "9d94a7f7f1124a2487b20db9711e13b4"
format_stamp: "Formatted at 2026-08-12 21:02:33 on dist-test-slave-h3ft"
server_key: "912ef6cfc11af6d0181773184a0c3849"
server_key_iv: "e1a12b4eb9021d57ba6d4e8ab9681766"
server_key_version: "encryptionkey@0"
I20260812 21:02:33.787958 9028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:33.802649 9028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:33.805608 9028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:33.805853 9028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:33.811590 9028 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:34505
I20260812 21:02:33.811673 9134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:34505 every 8 connection(s)
I20260812 21:02:33.812132 9028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:33.813326 9135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:33.813496 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 9028
I20260812 21:02:33.813648 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:33.813915 10361 external_mini_cluster.cc:1428] Setting key bb04dce5eb30dcfa323d593260261263
I20260812 21:02:33.817673 9135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4: Bootstrap starting.
I20260812 21:02:33.818534 9135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:33.818959 9135 log.cc:824] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:33.819924 9135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4: No bootstrap required, opened a new log
Aug 12 21:02:33 dist-test-slave-h3ft krb5kdc[9004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:33.822223 9135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d94a7f7f1124a2487b20db9711e13b4" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34505 } }
I20260812 21:02:33.822429 9135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:33.822494 9135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d94a7f7f1124a2487b20db9711e13b4, State: Initialized, Role: FOLLOWER
I20260812 21:02:33.822688 9135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d94a7f7f1124a2487b20db9711e13b4" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34505 } }
I20260812 21:02:33.822803 9135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:33.822839 9135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:33.822888 9135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:33.823829 9135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d94a7f7f1124a2487b20db9711e13b4" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34505 } }
I20260812 21:02:33.823964 9135 leader_election.cc:302] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d94a7f7f1124a2487b20db9711e13b4; no voters:
I20260812 21:02:33.824203 9135 leader_election.cc:288] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:33.824266 9143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:33.824463 9143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [term 1 LEADER]: Becoming Leader. State: Replica: 9d94a7f7f1124a2487b20db9711e13b4, State: Running, Role: LEADER
I20260812 21:02:33.824592 9135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:33.824575 9143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d94a7f7f1124a2487b20db9711e13b4" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34505 } }
I20260812 21:02:33.825546 9145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d94a7f7f1124a2487b20db9711e13b4. Latest consensus state: current_term: 1 leader_uuid: "9d94a7f7f1124a2487b20db9711e13b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d94a7f7f1124a2487b20db9711e13b4" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34505 } } }
I20260812 21:02:33.825644 9145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:33.825832 9146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d94a7f7f1124a2487b20db9711e13b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d94a7f7f1124a2487b20db9711e13b4" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 34505 } } }
I20260812 21:02:33.825947 9146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:33.827211 9139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:33.814666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50770 (local address 127.10.30.126:34505)
0812 21:02:33.814895 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:33.814908 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:33.814948 (+ 40us) server_negotiation.cc:407] Connection header received
0812 21:02:33.815532 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:33.815542 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:33.815616 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:33.815794 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:33.816523 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:33.817969 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:33.818848 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:33.819477 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:33.819620 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:33.822372 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:33.822377 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:33.822378 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:33.822391 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:33.824835 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:33.825280 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:33.825284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:33.825284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:33.825426 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:33.825675 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:33.825676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:33.825676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:33.826063 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:33.826213 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:33.826805 (+ 592us) server_negotiation.cc:299] Negotiation successful
0812 21:02:33.826994 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":104,"threads_started":1}
W20260812 21:02:33.827682 9167 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:02:33.827752 9167 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:02:33.828087 9154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:33.828293 9154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:33.830160 9154 catalog_manager.cc:1347] Generated new cluster ID: 599eab15492a4b90899309b01852a86e
I20260812 21:02:33.830231 9154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:33.843827 9154 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:33.844767 9154 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:33.849666 9154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4: Generated new TSK 0
I20260812 21:02:33.849951 9154 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 21:02:33.891672 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34505
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:34.020560 9174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:34.020874 9174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:34.020910 9174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:34.022358 9174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:34.022425 9174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:34.022459 9174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:02:34.024305 9174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:34.024681 9174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:34.025015 9174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:34.031318 9184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:34.031348 9187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:34.031320 9182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:34.031968 9174 server_base.cc:1034] running on GCE node
I20260812 21:02:34.032243 9174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:34.032548 9174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:34.033737 9174 hybrid_clock.cc:648] HybridClock initialized: now 1786568554033708 us; error 49 us; skew 500 ppm
Aug 12 21:02:34 dist-test-slave-h3ft krb5kdc[9004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:34.037297 9174 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:02:34.037827 9174 webserver.cc:460] Webserver started at http://127.10.30.65:38799/ using document root <none> and password file <none>
I20260812 21:02:34.038156 9174 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:34.038230 9174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:34.038398 9174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:34.039786 9174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "c99eeb60f66c4614a9cf68c5eb1430b4"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "c177ed2fbbf4298052e19e2c520d76fa"
server_key_iv: "58685bb5cc56064a8284b15b39e59399"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.040239 9174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "c99eeb60f66c4614a9cf68c5eb1430b4"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "c177ed2fbbf4298052e19e2c520d76fa"
server_key_iv: "58685bb5cc56064a8284b15b39e59399"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.042088 9174 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 21:02:34.043237 9195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.043567 9174 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260812 21:02:34.043733 9174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "c99eeb60f66c4614a9cf68c5eb1430b4"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "c177ed2fbbf4298052e19e2c520d76fa"
server_key_iv: "58685bb5cc56064a8284b15b39e59399"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.043833 9174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:34.084309 9174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:34.087476 9174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:34.087728 9174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:34.088079 9174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:34.088511 9174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:34.088570 9174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.088635 9174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:34.088668 9174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.097230 9174 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:44593
I20260812 21:02:34.097271 9383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:44593 every 8 connection(s)
I20260812 21:02:34.097754 9174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:02:34.102617 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 9174
I20260812 21:02:34.102811 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:02:34.103142 10361 external_mini_cluster.cc:1428] Setting key eb5dc70591de03aa78cbb40678275cd0
Aug 12 21:02:34 dist-test-slave-h3ft krb5kdc[9004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:34.112203 9139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.098796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:56457 (local address 127.10.30.126:34505)
0812 21:02:34.098875 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.098878 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.099213 (+ 335us) server_negotiation.cc:407] Connection header received
0812 21:02:34.099982 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.099984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.099997 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.100065 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:34.101612 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.102236 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.103955 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.104245 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.104337 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.107717 (+ 3380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:34.107720 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:34.107720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:34.107733 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:34.109904 (+ 2171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:34.110623 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:34.110627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:34.110627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:34.110713 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:34.111188 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:34.111190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:34.111190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:34.111406 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:34.111495 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.111865 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.112035 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 21:02:34.112254 9388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.098764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:34505 (local address 127.10.30.65:56457)
0812 21:02:34.098981 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.099085 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:34.099786 (+ 701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:34.100161 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:34.100166 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:34.100926 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:34.101437 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.101447 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.102388 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.102390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.103814 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.103819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.104357 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.104358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.104558 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.105322 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:34.105334 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:34.107545 (+ 2211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:34.110051 (+ 2506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:34.110064 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:34.110068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:34.110491 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:34.110812 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:34.110813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:34.110813 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:34.111075 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:34.111491 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:34.111502 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:34.111689 (+ 187us) client_negotiation.cc:769] Sending connection context
0812 21:02:34.111795 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 21:02:34.112008 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":115,"threads_started":1}
I20260812 21:02:34.113294 9386 heartbeater.cc:347] Connected to a master server at 127.10.30.126:34505
I20260812 21:02:34.113477 9386 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:34.113760 9386 heartbeater.cc:511] Master 127.10.30.126:34505 requested a full tablet report, sending...
I20260812 21:02:34.114698 9083 ts_manager.cc:194] Registered new tserver with Master: c99eeb60f66c4614a9cf68c5eb1430b4 (127.10.30.65:44593)
I20260812 21:02:34.115615 9083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:56457
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 21:02:34.143823 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34505
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:34.246258 9393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:34.246551 9393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:34.246582 9393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:34.248041 9393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:34.248098 9393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:34.248131 9393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:02:34.249789 9393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:34.250032 9393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:34.250280 9393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:34.256448 9403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:34.256477 9405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:34.256436 9402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:34.256758 9393 server_base.cc:1034] running on GCE node
I20260812 21:02:34.257165 9393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:34.257462 9393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:34.258652 9393 hybrid_clock.cc:648] HybridClock initialized: now 1786568554258632 us; error 33 us; skew 500 ppm
Aug 12 21:02:34 dist-test-slave-h3ft krb5kdc[9004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:34.262131 9393 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:02:34.262665 9393 webserver.cc:460] Webserver started at http://127.10.30.66:36467/ using document root <none> and password file <none>
I20260812 21:02:34.262990 9393 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:34.263149 9393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:34.263329 9393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:34.264691 9393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "788d42ff2d06416f94b2911e1a701a68"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "8e770b75b931cdb6d2f12444b9d6950a"
server_key_iv: "63c52bd5e0a9218532876839bbc3556e"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.265179 9393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "788d42ff2d06416f94b2911e1a701a68"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "8e770b75b931cdb6d2f12444b9d6950a"
server_key_iv: "63c52bd5e0a9218532876839bbc3556e"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.266903 9393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 21:02:34.267956 9421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.268280 9393 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:34.268399 9393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "788d42ff2d06416f94b2911e1a701a68"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "8e770b75b931cdb6d2f12444b9d6950a"
server_key_iv: "63c52bd5e0a9218532876839bbc3556e"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.268489 9393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:34.301086 9393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:34.304041 9393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:34.304241 9393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:34.304564 9393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:34.304946 9393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:34.305002 9393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.305058 9393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:34.305086 9393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.312613 9393 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:40047
I20260812 21:02:34.312731 9603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:40047 every 8 connection(s)
I20260812 21:02:34.313095 9393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
Aug 12 21:02:34 dist-test-slave-h3ft krb5kdc[9004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:34.323048 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 9393
I20260812 21:02:34.323227 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:02:34.323493 10361 external_mini_cluster.cc:1428] Setting key a45d215f931be79cf8db0e6e93fcbf20
I20260812 21:02:34.325445 9139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.314077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:52363 (local address 127.10.30.126:34505)
0812 21:02:34.314167 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.314170 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.314377 (+ 207us) server_negotiation.cc:407] Connection header received
0812 21:02:34.315062 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.315064 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.315085 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.315158 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:34.316301 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.316898 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.318087 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.318334 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.318412 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.321513 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:34.321516 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:34.321516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:34.321527 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:34.323600 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:34.324243 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:34.324245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:34.324246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:34.324323 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:34.324640 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:34.324641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:34.324642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:34.324784 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:34.324862 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.325217 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.325326 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 21:02:34.325758 9611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.313987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:34505 (local address 127.10.30.66:52363)
0812 21:02:34.314224 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.314275 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:34.314887 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:34.315258 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:34.315262 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:34.315948 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:34.316191 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.316197 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.317022 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.317023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.317970 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.317973 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.318431 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.318431 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.318551 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.319327 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:34.319338 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:34.321349 (+ 2011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:34.323719 (+ 2370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:34.323735 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:34.323739 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:34.324118 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:34.324400 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:34.324401 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:34.324402 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:34.324553 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:34.324865 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:34.324874 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:34.325052 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 21:02:34.325194 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 21:02:34.325445 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":128,"threads_started":1}
I20260812 21:02:34.327852 9606 heartbeater.cc:347] Connected to a master server at 127.10.30.126:34505
I20260812 21:02:34.328003 9606 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:34.328279 9606 heartbeater.cc:511] Master 127.10.30.126:34505 requested a full tablet report, sending...
I20260812 21:02:34.328918 9083 ts_manager.cc:194] Registered new tserver with Master: 788d42ff2d06416f94b2911e1a701a68 (127.10.30.66:40047)
I20260812 21:02:34.329552 9083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:52363
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 21:02:34.361174 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34505
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:34.468601 9616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:34.468884 9616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:34.468932 9616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:34.470606 9616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:34.470705 9616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:34.470744 9616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:02:34.472877 9616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:34505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:34.473241 9616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:34.473519 9616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:34.480063 9622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:34.480132 9621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:34.480142 9625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:34.480180 9616 server_base.cc:1034] running on GCE node
I20260812 21:02:34.480695 9616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:34.481061 9616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:34.482285 9616 hybrid_clock.cc:648] HybridClock initialized: now 1786568554482269 us; error 37 us; skew 500 ppm
Aug 12 21:02:34 dist-test-slave-h3ft krb5kdc[9004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:34.485551 9616 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:02:34.486078 9616 webserver.cc:460] Webserver started at http://127.10.30.67:33039/ using document root <none> and password file <none>
I20260812 21:02:34.486351 9616 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:34.486404 9616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:34.486559 9616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:34.487920 9616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "d9037532455642048e2fff981f15e563"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "bd6ba07299fecda1b20e541b06ad44df"
server_key_iv: "44d3490625c2b397d2f2272c5f5fc9f1"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.488353 9616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "d9037532455642048e2fff981f15e563"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "bd6ba07299fecda1b20e541b06ad44df"
server_key_iv: "44d3490625c2b397d2f2272c5f5fc9f1"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.490130 9616 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 21:02:34.491295 9637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.491514 9616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:34.491639 9616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "d9037532455642048e2fff981f15e563"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "bd6ba07299fecda1b20e541b06ad44df"
server_key_iv: "44d3490625c2b397d2f2272c5f5fc9f1"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.491730 9616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:34.505714 9616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:34.508356 9616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:34.508559 9616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:34.508865 9616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:34.509287 9616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:34.509344 9616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.509393 9616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:34.509420 9616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.516651 9616 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:41931
I20260812 21:02:34.516706 9816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:41931 every 8 connection(s)
I20260812 21:02:34.517131 9616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:02:34.519675 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 9616
I20260812 21:02:34.519848 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:02:34.520098 10361 external_mini_cluster.cc:1428] Setting key 97418a58b3d4e78b98247e312c876ef5
Aug 12 21:02:34 dist-test-slave-h3ft krb5kdc[9004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:34.529438 9139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.518170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:49951 (local address 127.10.30.126:34505)
0812 21:02:34.518250 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.518252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.518468 (+ 216us) server_negotiation.cc:407] Connection header received
0812 21:02:34.519144 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.519146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.519159 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.519228 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:34.520506 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.521436 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.522548 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.522785 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.522853 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.526013 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:34.526015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:34.526015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:34.526025 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:34.527768 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:34.528267 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:34.528268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:34.528268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:34.528336 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:34.528650 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:34.528652 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:34.528652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:34.528809 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:34.528877 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.529242 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.529339 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 21:02:34.529731 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.518052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:34505 (local address 127.10.30.67:49951)
0812 21:02:34.518329 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.518374 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:34.518985 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:34.519311 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:34.519315 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:34.520111 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:34.520386 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.520392 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.521526 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.521527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.522444 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.522447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.522874 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.522875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.523082 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.523754 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:34.523765 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:34.525840 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:34.527872 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:34.527881 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:34.527885 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:34.528175 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:34.528420 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:34.528421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:34.528421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:34.528555 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:34.528880 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:34.528886 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:34.529070 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 21:02:34.529176 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 21:02:34.529351 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":129,"threads_started":1}
I20260812 21:02:34.530404 9817 heartbeater.cc:347] Connected to a master server at 127.10.30.126:34505
I20260812 21:02:34.530551 9817 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:34.530803 9817 heartbeater.cc:511] Master 127.10.30.126:34505 requested a full tablet report, sending...
I20260812 21:02:34.531387 9083 ts_manager.cc:194] Registered new tserver with Master: d9037532455642048e2fff981f15e563 (127.10.30.67:41931)
I20260812 21:02:34.531920 9083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:49951
I20260812 21:02:34.532464 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:02:34.542177 9139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.534333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50786 (local address 127.10.30.126:34505)
0812 21:02:34.534433 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.534435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.534533 (+ 98us) server_negotiation.cc:407] Connection header received
0812 21:02:34.534627 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.534628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.534640 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.534701 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:34.535497 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.536028 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.536834 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.537062 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.537139 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.538870 (+ 1731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:34.538872 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:34.538872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:34.538883 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:34.540565 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:34.541097 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:34.541099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:34.541099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:34.541184 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:34.541451 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:34.541453 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:34.541453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:34.541664 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:34.541818 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.541963 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.542044 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 21:02:34.544606 9083 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:02:34.546838 9083 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:02:34.554919 9841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.550044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:44593 (local address 127.0.0.1:52136)
0812 21:02:34.550284 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.550336 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:34.550426 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:34.551114 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:34.551115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:34.551118 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:34.551239 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.551241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.552237 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.552239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.553610 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.553613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.554685 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.554685 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.554754 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.554758 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:34.554812 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 21:02:34.554849 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":29,"thread_start_us":92,"threads_started":1}
I20260812 21:02:34.555028 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.550426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52136 (local address 127.10.30.65:44593)
0812 21:02:34.550787 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.550792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.550805 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:02:34.550864 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.550866 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.550885 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.550978 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:34.551310 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.552114 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.553720 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.554603 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.554690 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.554757 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.554826 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.554888 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":79,"threads_started":1}
I20260812 21:02:34.555182 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.550430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44016 (local address 127.10.30.66:40047)
0812 21:02:34.550693 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.550699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.550722 (+ 23us) server_negotiation.cc:407] Connection header received
0812 21:02:34.550776 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.550778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.550797 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.550883 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:34.551291 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.552511 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.553791 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.554414 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.554508 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.554596 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.554971 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.555076 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":144,"threads_started":1}
I20260812 21:02:34.554919 9839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.550057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:40047 (local address 127.0.0.1:44016)
0812 21:02:34.550541 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.550549 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:34.550612 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:34.551047 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:34.551051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:34.551055 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:34.551183 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.551187 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.552664 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.552665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.553707 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.553710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.554522 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.554523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.554617 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.554633 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 21:02:34.554709 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 21:02:34.554780 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":97,"thread_start_us":112,"threads_started":1}
I20260812 21:02:34.555852 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.550071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:41931 (local address 127.0.0.1:51252)
0812 21:02:34.550632 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.550647 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:34.550711 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:34.551115 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:34.551116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:34.551121 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:34.551247 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.551249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.552666 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.552668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.553788 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.553790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.554806 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.554807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.554887 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.554892 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:02:34.554946 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 21:02:34.554997 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":43,"thread_start_us":120,"threads_started":1}
I20260812 21:02:34.556150 9842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.550296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.10.30.67:41931)
0812 21:02:34.550891 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.550895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.550905 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:02:34.550958 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.550960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.550977 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.551166 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:34.551355 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.552532 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.553863 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.554644 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.554710 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.554764 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.555990 (+ 1226us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.556063 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":146,"threads_started":1}
I20260812 21:02:34.556037 9275 tablet_service.cc:1467] Processing CreateTablet for tablet 78f903a7b4e041f988a2b41b7743fb7e (DEFAULT_TABLE table=test-table [id=902d454332bd4f9c91398c1158d34ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:34.556039 9504 tablet_service.cc:1467] Processing CreateTablet for tablet 78f903a7b4e041f988a2b41b7743fb7e (DEFAULT_TABLE table=test-table [id=902d454332bd4f9c91398c1158d34ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:34.556520 9275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f903a7b4e041f988a2b41b7743fb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:34.556520 9504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f903a7b4e041f988a2b41b7743fb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:34.560029 9848 tablet_bootstrap.cc:492] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: Bootstrap starting.
I20260812 21:02:34.560055 9715 tablet_service.cc:1467] Processing CreateTablet for tablet 78f903a7b4e041f988a2b41b7743fb7e (DEFAULT_TABLE table=test-table [id=902d454332bd4f9c91398c1158d34ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:34.560484 9715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f903a7b4e041f988a2b41b7743fb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:34.560515 9849 tablet_bootstrap.cc:492] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4: Bootstrap starting.
I20260812 21:02:34.560962 9848 tablet_bootstrap.cc:654] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:34.561291 9849 tablet_bootstrap.cc:654] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:34.561697 9848 log.cc:824] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:34.562036 9849 log.cc:824] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:34.562695 9848 tablet_bootstrap.cc:492] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: No bootstrap required, opened a new log
I20260812 21:02:34.562770 9848 ts_tablet_manager.cc:1397] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:02:34.562973 9849 tablet_bootstrap.cc:492] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4: No bootstrap required, opened a new log
I20260812 21:02:34.563077 9849 ts_tablet_manager.cc:1397] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:02:34.564271 9853 tablet_bootstrap.cc:492] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: Bootstrap starting.
I20260812 21:02:34.565039 9853 tablet_bootstrap.cc:654] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:34.565160 9848 raft_consensus.cc:348] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.565388 9848 raft_consensus.cc:374] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:34.565438 9848 raft_consensus.cc:729] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788d42ff2d06416f94b2911e1a701a68, State: Initialized, Role: FOLLOWER
I20260812 21:02:34.565327 9849 raft_consensus.cc:348] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.565541 9849 raft_consensus.cc:374] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:34.565589 9849 raft_consensus.cc:729] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99eeb60f66c4614a9cf68c5eb1430b4, State: Initialized, Role: FOLLOWER
I20260812 21:02:34.565579 9848 consensus_queue.cc:260] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.565729 9853 log.cc:824] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:34.565745 9849 consensus_queue.cc:260] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.565944 9848 ts_tablet_manager.cc:1428] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:02:34.566033 9606 heartbeater.cc:503] Master 127.10.30.126:34505 was elected leader, sending a full tablet report...
I20260812 21:02:34.566540 9849 ts_tablet_manager.cc:1428] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:02:34.566676 9386 heartbeater.cc:503] Master 127.10.30.126:34505 was elected leader, sending a full tablet report...
I20260812 21:02:34.566805 9853 tablet_bootstrap.cc:492] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: No bootstrap required, opened a new log
I20260812 21:02:34.566888 9853 ts_tablet_manager.cc:1397] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:02:34.568872 9853 raft_consensus.cc:348] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.569049 9853 raft_consensus.cc:374] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:34.569074 9853 raft_consensus.cc:729] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9037532455642048e2fff981f15e563, State: Initialized, Role: FOLLOWER
I20260812 21:02:34.569237 9853 consensus_queue.cc:260] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.569559 9853 ts_tablet_manager.cc:1428] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:02:34.569602 9817 heartbeater.cc:503] Master 127.10.30.126:34505 was elected leader, sending a full tablet report...
W20260812 21:02:34.598726 9387 tablet.cc:2369] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:02:34.659642 9863 raft_consensus.cc:482] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:34.659852 9863 raft_consensus.cc:504] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.660368 9863 leader_election.cc:288] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 788d42ff2d06416f94b2911e1a701a68 (127.10.30.66:40047), d9037532455642048e2fff981f15e563 (127.10.30.67:41931)
I20260812 21:02:34.665304 9842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.660854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:37483 (local address 127.10.30.67:41931)
0812 21:02:34.660918 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.660920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.661088 (+ 168us) server_negotiation.cc:407] Connection header received
0812 21:02:34.661134 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.661135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.661147 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.661217 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:34.661482 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.662329 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.664096 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.664817 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.664953 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.664965 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.665147 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.665209 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 21:02:34.665304 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.660737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:40469 (local address 127.10.30.66:40047)
0812 21:02:34.660809 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.660812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.661067 (+ 255us) server_negotiation.cc:407] Connection header received
0812 21:02:34.661124 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.661126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.661145 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.661220 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:34.661491 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.662308 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.664103 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.664817 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.664924 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.664941 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.665152 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.665213 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 21:02:34.665328 9868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.660637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:40047 (local address 127.10.30.65:40469)
0812 21:02:34.660960 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.660969 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:34.661032 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:34.661236 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:34.661237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:34.661239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:34.661372 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.661377 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.662435 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.662436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.663949 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.663954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.664925 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.664927 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.665031 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.665040 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 21:02:34.665113 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 21:02:34.665179 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":113,"thread_start_us":160,"threads_started":1}
I20260812 21:02:34.665333 9867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.660636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:41931 (local address 127.10.30.65:37483)
0812 21:02:34.660899 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.660914 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:34.661017 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:34.661236 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:34.661237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:34.661241 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:34.661372 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.661375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.662434 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.662436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.663999 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:34.664001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.664991 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.664992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:34.665065 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.665069 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:34.665125 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 21:02:34.665179 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":106,"thread_start_us":162,"threads_started":1}
I20260812 21:02:34.665922 9532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f903a7b4e041f988a2b41b7743fb7e" candidate_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788d42ff2d06416f94b2911e1a701a68" is_pre_election: true
I20260812 21:02:34.665951 9745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f903a7b4e041f988a2b41b7743fb7e" candidate_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9037532455642048e2fff981f15e563" is_pre_election: true
I20260812 21:02:34.666141 9532 raft_consensus.cc:2454] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99eeb60f66c4614a9cf68c5eb1430b4 in term 0.
I20260812 21:02:34.666162 9745 raft_consensus.cc:2454] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99eeb60f66c4614a9cf68c5eb1430b4 in term 0.
I20260812 21:02:34.666450 9199 leader_election.cc:302] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788d42ff2d06416f94b2911e1a701a68, c99eeb60f66c4614a9cf68c5eb1430b4; no voters:
I20260812 21:02:34.666636 9863 raft_consensus.cc:2781] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:02:34.666711 9863 raft_consensus.cc:482] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:02:34.666743 9863 raft_consensus.cc:3037] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:34.667765 9863 raft_consensus.cc:504] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.667963 9863 leader_election.cc:288] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [CANDIDATE]: Term 1 election: Requested vote from peers 788d42ff2d06416f94b2911e1a701a68 (127.10.30.66:40047), d9037532455642048e2fff981f15e563 (127.10.30.67:41931)
I20260812 21:02:34.668160 9532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f903a7b4e041f988a2b41b7743fb7e" candidate_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788d42ff2d06416f94b2911e1a701a68"
I20260812 21:02:34.668190 9745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f903a7b4e041f988a2b41b7743fb7e" candidate_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9037532455642048e2fff981f15e563"
I20260812 21:02:34.668279 9745 raft_consensus.cc:3037] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:34.668279 9532 raft_consensus.cc:3037] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:34.669503 9745 raft_consensus.cc:2454] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99eeb60f66c4614a9cf68c5eb1430b4 in term 1.
I20260812 21:02:34.669504 9532 raft_consensus.cc:2454] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99eeb60f66c4614a9cf68c5eb1430b4 in term 1.
I20260812 21:02:34.669760 9199 leader_election.cc:302] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788d42ff2d06416f94b2911e1a701a68, c99eeb60f66c4614a9cf68c5eb1430b4; no voters:
I20260812 21:02:34.669939 9863 raft_consensus.cc:2781] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:34.670186 9863 raft_consensus.cc:686] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 1 LEADER]: Becoming Leader. State: Replica: c99eeb60f66c4614a9cf68c5eb1430b4, State: Running, Role: LEADER
I20260812 21:02:34.670306 9863 consensus_queue.cc:237] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } }
I20260812 21:02:34.671492 9082 catalog_manager.cc:5495] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99eeb60f66c4614a9cf68c5eb1430b4 (127.10.30.65). New cstate: current_term: 1 leader_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c99eeb60f66c4614a9cf68c5eb1430b4" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 44593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260812 21:02:34.707496 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.704705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52142 (local address 127.10.30.65:44593)
0812 21:02:34.704783 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.704785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.704794 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:02:34.704856 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.704857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.704883 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.704980 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:02:34.705151 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.705746 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.706616 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.706852 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.706926 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.707155 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:02:34.707270 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:02:34.707373 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.707395 (+ 22us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.707411 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 21:02:34.710153 9532 raft_consensus.cc:1261] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 1 FOLLOWER]: Refusing update from remote peer c99eeb60f66c4614a9cf68c5eb1430b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:34.710153 9745 raft_consensus.cc:1261] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 1 FOLLOWER]: Refusing update from remote peer c99eeb60f66c4614a9cf68c5eb1430b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:34.710633 9863 consensus_queue.cc:1035] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9037532455642048e2fff981f15e563" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:34.710852 9869 consensus_queue.cc:1035] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "788d42ff2d06416f94b2911e1a701a68" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:34.714428 9874 mvcc.cc:205] Tried to move back new op lower bound from 7317784800088883200 to 7317784799930535936. Current Snapshot: MvccSnapshot[applied={T|T < 7317784800088883200}]
I20260812 21:02:34.717803 9082 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:34.717945 9082 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:34.719019 9082 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d94a7f7f1124a2487b20db9711e13b4: Sending DeleteTablet for 3 replicas of tablet 78f903a7b4e041f988a2b41b7743fb7e
I20260812 21:02:34.719481 9504 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f903a7b4e041f988a2b41b7743fb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:34 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:44016
I20260812 21:02:34.719472 9715 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f903a7b4e041f988a2b41b7743fb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:34 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:51252
I20260812 21:02:34.719760 9275 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f903a7b4e041f988a2b41b7743fb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:34 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:52136
I20260812 21:02:34.720088 9890 tablet_replica.cc:330] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4: stopping tablet replica
I20260812 21:02:34.720225 9890 raft_consensus.cc:2229] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:02:34.720208 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 9174
I20260812 21:02:34.720393 9890 raft_consensus.cc:2258] T 78f903a7b4e041f988a2b41b7743fb7e P c99eeb60f66c4614a9cf68c5eb1430b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:34.720244 9887 tablet_replica.cc:330] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: stopping tablet replica
I20260812 21:02:34.721194 9887 raft_consensus.cc:2229] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:02:34.721372 9887 raft_consensus.cc:2258] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:34.721599 9888 tablet_replica.cc:330] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: stopping tablet replica
I20260812 21:02:34.721756 9888 raft_consensus.cc:2229] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:02:34.721895 9888 raft_consensus.cc:2258] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:34.725399 9888 ts_tablet_manager.cc:1905] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:34.727730 9888 ts_tablet_manager.cc:1918] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:34.727903 9888 log.cc:1196] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/78f903a7b4e041f988a2b41b7743fb7e
I20260812 21:02:34.728299 9888 ts_tablet_manager.cc:1939] T 78f903a7b4e041f988a2b41b7743fb7e P d9037532455642048e2fff981f15e563: Deleting consensus metadata
I20260812 21:02:34.728896 9064 catalog_manager.cc:4841] TS d9037532455642048e2fff981f15e563 (127.10.30.67:41931): tablet 78f903a7b4e041f988a2b41b7743fb7e (table test-table [id=902d454332bd4f9c91398c1158d34ec1]) successfully deleted
I20260812 21:02:34.729570 9887 ts_tablet_manager.cc:1905] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:34.732161 9887 ts_tablet_manager.cc:1918] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:34.732276 9887 log.cc:1196] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/78f903a7b4e041f988a2b41b7743fb7e
I20260812 21:02:34.732650 9887 ts_tablet_manager.cc:1939] T 78f903a7b4e041f988a2b41b7743fb7e P 788d42ff2d06416f94b2911e1a701a68: Deleting consensus metadata
I20260812 21:02:34.733294 9062 catalog_manager.cc:4841] TS 788d42ff2d06416f94b2911e1a701a68 (127.10.30.66:40047): tablet 78f903a7b4e041f988a2b41b7743fb7e (table test-table [id=902d454332bd4f9c91398c1158d34ec1]) successfully deleted
W20260812 21:02:34.739224 9061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:44593 (error 108)
I20260812 21:02:34.739558 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 9393
I20260812 21:02:34.751358 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.749332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:44593 (local address 127.0.0.1:52154)
0812 21:02:34.751161 (+ 1829us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:34.751271 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:44593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1784}
W20260812 21:02:34.754972 9061 catalog_manager.cc:4584] TS c99eeb60f66c4614a9cf68c5eb1430b4 (127.10.30.65:44593): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78f903a7b4e041f988a2b41b7743fb7e: Network error: Client connection negotiation failed: client connection to 127.10.30.65:44593: connect: Connection refused (error 111)
I20260812 21:02:34.763159 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 9616
I20260812 21:02:34.781641 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 9028
2026-08-12T21:02:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2684 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T21:02:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:34Z Disabled control of system clock
I20260812 21:02:34.828814 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44083
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:43525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:44083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:34.928993 9899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:34.929311 9899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:34.929337 9899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:34.930584 9899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:34.930630 9899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:34.930644 9899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:34.930657 9899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:34.930670 9899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:34.932214 9899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:44083
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:34.932495 9899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:34.932829 9899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:34.939474 9909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:34.939498 9914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:34.939474 9908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:34.939929 9899 server_base.cc:1034] running on GCE node
I20260812 21:02:34.940287 9899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:34.940697 9899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:34.941872 9899 hybrid_clock.cc:648] HybridClock initialized: now 1786568554941860 us; error 50 us; skew 500 ppm
I20260812 21:02:34.943724 9899 webserver.cc:460] Webserver started at http://127.10.30.126:46323/ using document root <none> and password file <none>
I20260812 21:02:34.944075 9899 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:34.944157 9899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:34.944347 9899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:34.945715 9899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "2dd1d789aee74246bcb0a10f5984907a"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "af6ae8db9b2c2448c42388bf70a78605"
server_key_iv: "8d82c88478047d11c560513637ffe99c"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.946106 9899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "2dd1d789aee74246bcb0a10f5984907a"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "af6ae8db9b2c2448c42388bf70a78605"
server_key_iv: "8d82c88478047d11c560513637ffe99c"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.947913 9899 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 21:02:34.948935 9924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:34.949172 9899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:34.949281 9899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "2dd1d789aee74246bcb0a10f5984907a"
format_stamp: "Formatted at 2026-08-12 21:02:34 on dist-test-slave-h3ft"
server_key: "af6ae8db9b2c2448c42388bf70a78605"
server_key_iv: "8d82c88478047d11c560513637ffe99c"
server_key_version: "encryptionkey@0"
I20260812 21:02:34.949358 9899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:34.969300 9899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:34.969717 9899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:34.969848 9899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:34.975039 9899 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:44083
I20260812 21:02:34.975093 10006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:44083 every 8 connection(s)
I20260812 21:02:34.975569 9899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:34.976933 10009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:34.979964 10009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a: Bootstrap starting.
I20260812 21:02:34.980690 10009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:34.981058 10009 log.cc:824] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:34.982043 10009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a: No bootstrap required, opened a new log
I20260812 21:02:34.984263 10009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd1d789aee74246bcb0a10f5984907a" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44083 } }
I20260812 21:02:34.984475 10009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:34.984552 10009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dd1d789aee74246bcb0a10f5984907a, State: Initialized, Role: FOLLOWER
I20260812 21:02:34.984772 10009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd1d789aee74246bcb0a10f5984907a" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44083 } }
I20260812 21:02:34.984887 10009 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:34.984939 10009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:34.984995 10009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:34.985200 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 9899
I20260812 21:02:34.985330 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:34.985555 10361 external_mini_cluster.cc:1428] Setting key 8540c2f1b1060e62ee09a2955a8dac2f
I20260812 21:02:34.985827 10009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd1d789aee74246bcb0a10f5984907a" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44083 } }
I20260812 21:02:34.985971 10009 leader_election.cc:302] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dd1d789aee74246bcb0a10f5984907a; no voters:
I20260812 21:02:34.986234 10009 leader_election.cc:288] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:34.986549 10019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:34.986639 10009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:34.986703 10019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [term 1 LEADER]: Becoming Leader. State: Replica: 2dd1d789aee74246bcb0a10f5984907a, State: Running, Role: LEADER
I20260812 21:02:34.986804 10019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd1d789aee74246bcb0a10f5984907a" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44083 } }
I20260812 21:02:34.987221 10019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dd1d789aee74246bcb0a10f5984907a. Latest consensus state: current_term: 1 leader_uuid: "2dd1d789aee74246bcb0a10f5984907a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd1d789aee74246bcb0a10f5984907a" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44083 } } }
I20260812 21:02:34.987314 10019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:34.987514 10020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2dd1d789aee74246bcb0a10f5984907a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd1d789aee74246bcb0a10f5984907a" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44083 } } }
I20260812 21:02:34.987723 10020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:34.988294 10026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:34.988943 10026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:34.991184 10026 catalog_manager.cc:1347] Generated new cluster ID: 7d01fb30b1a94111a444bf32e6cb436a
I20260812 21:02:34.991251 10026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:34.993019 10018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:34.986187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52524 (local address 127.10.30.126:44083)
0812 21:02:34.986453 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:34.986465 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:34.986507 (+ 42us) server_negotiation.cc:407] Connection header received
0812 21:02:34.986663 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:34.986675 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:34.986762 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:34.987317 (+ 555us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:34.987436 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.989028 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.990281 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:34.990865 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:34.990966 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:34.991942 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:34.991947 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:34.991948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:34.992216 (+ 268us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:34.992265 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:34.992284 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:34.992599 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:34.992641 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 21:02:34.992737 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":127,"threads_started":1}
I20260812 21:02:35.017026 10026 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:35.017683 10026 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:35.020282 10026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a: Generated new TSK 0
I20260812 21:02:35.020529 10026 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:35.029078 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44083
--builtin_ntp_servers=127.10.30.84:43525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:35.135164 10046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:35.135429 10046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:35.135459 10046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:35.137081 10046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:35.137135 10046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:35.137168 10046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:02:35.139108 10046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:35.139469 10046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:35.139860 10046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:35.146916 10055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:35.146951 10058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:35.146916 10053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:35.147296 10046 server_base.cc:1034] running on GCE node
I20260812 21:02:35.147553 10046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:35.147847 10046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:35.149047 10046 hybrid_clock.cc:648] HybridClock initialized: now 1786568555149023 us; error 43 us; skew 500 ppm
I20260812 21:02:35.150666 10046 webserver.cc:460] Webserver started at http://127.10.30.65:34815/ using document root <none> and password file <none>
I20260812 21:02:35.151080 10046 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:35.151161 10046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:35.151327 10046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:35.152711 10046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "d9f7173592a444b482f5425af0045d85"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "05a62da1951633538981e74754924ffd"
server_key_iv: "2123244c853c133908de13030b9df4c3"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.153182 10046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "d9f7173592a444b482f5425af0045d85"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "05a62da1951633538981e74754924ffd"
server_key_iv: "2123244c853c133908de13030b9df4c3"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.154867 10046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 21:02:35.155944 10065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.156199 10046 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:35.156327 10046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "d9f7173592a444b482f5425af0045d85"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "05a62da1951633538981e74754924ffd"
server_key_iv: "2123244c853c133908de13030b9df4c3"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.156405 10046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:35.169219 10046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:35.169628 10046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:35.169764 10046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:35.170033 10046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:35.170383 10046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:35.170425 10046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.170452 10046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:35.170465 10046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.178475 10046 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:35151
I20260812 21:02:35.178570 10245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:35151 every 8 connection(s)
I20260812 21:02:35.179039 10046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:02:35.185441 10018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.180019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:59437 (local address 127.10.30.126:44083)
0812 21:02:35.180112 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.180115 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.180433 (+ 318us) server_negotiation.cc:407] Connection header received
0812 21:02:35.181065 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.181066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.181084 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.181148 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:35.182011 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.182580 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.183756 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.183962 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.184026 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.185073 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:35.185075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:35.185075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:35.185081 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:35.185101 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:35.185106 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:35.185158 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.185310 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.185349 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 21:02:35.185761 10250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.180016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44083 (local address 127.10.30.65:59437)
0812 21:02:35.180267 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.180311 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:35.180951 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:35.181212 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:35.181215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:35.181226 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:35.181902 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.181909 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.182684 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.182685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.183670 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.183673 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.184048 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.184049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.184183 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.184911 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:35.184911 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:35.184955 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:35.184982 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:35.185208 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:35.185217 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:35.185220 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 21:02:35.185304 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 21:02:35.185432 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":115,"threads_started":1}
I20260812 21:02:35.186550 10248 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44083
I20260812 21:02:35.186702 10248 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:35.186986 10248 heartbeater.cc:511] Master 127.10.30.126:44083 requested a full tablet report, sending...
I20260812 21:02:35.187283 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10046
I20260812 21:02:35.187422 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:02:35.187692 10361 external_mini_cluster.cc:1428] Setting key 2f8c078bbf3c1979a3abcd6d7eb865d7
I20260812 21:02:35.187788 9950 ts_manager.cc:194] Registered new tserver with Master: d9f7173592a444b482f5425af0045d85 (127.10.30.65:35151)
I20260812 21:02:35.188859 9950 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.65:59437
I20260812 21:02:35.189198 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44083
--builtin_ntp_servers=127.10.30.84:43525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:35.288555 10251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:35.288822 10251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:35.288846 10251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:35.290170 10251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:35.290217 10251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:35.290244 10251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:02:35.291716 10251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:35.292011 10251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:35.292379 10251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:35.298610 10259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:35.298635 10262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:35.298617 10265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:35.298695 10251 server_base.cc:1034] running on GCE node
I20260812 21:02:35.299115 10251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:35.299384 10251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:35.300559 10251 hybrid_clock.cc:648] HybridClock initialized: now 1786568555300525 us; error 60 us; skew 500 ppm
I20260812 21:02:35.302263 10251 webserver.cc:460] Webserver started at http://127.10.30.66:38397/ using document root <none> and password file <none>
I20260812 21:02:35.302569 10251 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:35.302623 10251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:35.302802 10251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:35.304134 10251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "7c9cd20f3903413fba66c6e5643ea1d2"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "6ae11dfc223f0d9f7958fb37090f249c"
server_key_iv: "ccf126d0b77d891f8d8db1e7433197c3"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.304558 10251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "7c9cd20f3903413fba66c6e5643ea1d2"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "6ae11dfc223f0d9f7958fb37090f249c"
server_key_iv: "ccf126d0b77d891f8d8db1e7433197c3"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.306116 10251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 21:02:35.307299 10279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.307576 10251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:35.307698 10251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "7c9cd20f3903413fba66c6e5643ea1d2"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "6ae11dfc223f0d9f7958fb37090f249c"
server_key_iv: "ccf126d0b77d891f8d8db1e7433197c3"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.307783 10251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:35.317082 10251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:35.317492 10251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:35.317628 10251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:35.317854 10251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:35.318270 10251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:35.318342 10251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.318382 10251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:35.318395 10251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.325713 10251 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:43627
I20260812 21:02:35.325788 10475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:43627 every 8 connection(s)
I20260812 21:02:35.326221 10251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:02:35.326967 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10251
I20260812 21:02:35.327147 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:02:35.327430 10361 external_mini_cluster.cc:1428] Setting key 40cb37d6081527b55372d11d23250eb6
I20260812 21:02:35.328847 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44083
--builtin_ntp_servers=127.10.30.84:43525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 21:02:35.333047 10018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.327235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:36913 (local address 127.10.30.126:44083)
0812 21:02:35.327318 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.327321 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.327626 (+ 305us) server_negotiation.cc:407] Connection header received
0812 21:02:35.328366 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.328367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.328382 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.328446 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:35.329317 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.329868 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.330983 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.331364 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.331447 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.332681 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:35.332683 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:35.332683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:35.332690 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:35.332713 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:35.332719 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:35.332772 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.332873 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.332912 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 21:02:35.333312 10479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.327236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44083 (local address 127.10.30.66:36913)
0812 21:02:35.327465 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.327515 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:35.328252 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:35.328539 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:35.328544 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:35.328560 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:35.329218 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.329225 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.329991 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.329992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.330867 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.330869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.331496 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.331497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.331668 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.332474 (+ 806us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:35.332475 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:35.332518 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:35.332552 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:35.332786 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:35.332793 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:35.332797 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:35.332871 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 21:02:35.332990 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":104,"threads_started":1}
I20260812 21:02:35.334000 10476 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44083
I20260812 21:02:35.334131 10476 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:35.334395 10476 heartbeater.cc:511] Master 127.10.30.126:44083 requested a full tablet report, sending...
I20260812 21:02:35.334975 9950 ts_manager.cc:194] Registered new tserver with Master: 7c9cd20f3903413fba66c6e5643ea1d2 (127.10.30.66:43627)
I20260812 21:02:35.335533 9950 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.66:36913
W20260812 21:02:35.430307 10482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:35.430577 10482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:35.430603 10482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:35.432138 10482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:35.432194 10482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:35.432224 10482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:02:35.433773 10482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:44083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:35.434101 10482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:35.434536 10482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:35.440555 10492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:35.440550 10490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:35.440555 10495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:35.441074 10482 server_base.cc:1034] running on GCE node
I20260812 21:02:35.441335 10482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:35.441629 10482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:35.442804 10482 hybrid_clock.cc:648] HybridClock initialized: now 1786568555442780 us; error 49 us; skew 500 ppm
I20260812 21:02:35.444487 10482 webserver.cc:460] Webserver started at http://127.10.30.67:37819/ using document root <none> and password file <none>
I20260812 21:02:35.444886 10482 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:35.444967 10482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:35.445139 10482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:35.446461 10482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "89b8e43379fc4939821f0206056688ec"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "b0fb208713096b8fc350a0f454e1594e"
server_key_iv: "fed72a4f6bad1f911f3c3476b90b534c"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.446910 10482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "89b8e43379fc4939821f0206056688ec"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "b0fb208713096b8fc350a0f454e1594e"
server_key_iv: "fed72a4f6bad1f911f3c3476b90b534c"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.448582 10482 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:35.449534 10505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.449795 10482 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:35.449954 10482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "89b8e43379fc4939821f0206056688ec"
format_stamp: "Formatted at 2026-08-12 21:02:35 on dist-test-slave-h3ft"
server_key: "b0fb208713096b8fc350a0f454e1594e"
server_key_iv: "fed72a4f6bad1f911f3c3476b90b534c"
server_key_version: "encryptionkey@0"
I20260812 21:02:35.450049 10482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:35.469295 10482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:35.469775 10482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:35.470041 10482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:35.470386 10482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:35.470827 10482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:35.470891 10482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.470956 10482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:35.470980 10482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:35.479053 10482 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:46195
I20260812 21:02:35.479120 10679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:46195 every 8 connection(s)
I20260812 21:02:35.479708 10482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:02:35.486158 10018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.480716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:40243 (local address 127.10.30.126:44083)
0812 21:02:35.480806 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.480809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.481127 (+ 318us) server_negotiation.cc:407] Connection header received
0812 21:02:35.481804 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.481806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.481822 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.481886 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:35.482730 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.483358 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.484481 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.484686 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.484764 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.485808 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:35.485810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:35.485810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:35.485817 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:35.485842 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:35.485847 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:35.485908 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.486011 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.486052 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 21:02:35.486480 10684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.480710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:44083 (local address 127.10.30.67:40243)
0812 21:02:35.480979 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.481025 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:35.481681 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:35.481989 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:35.481993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:35.482003 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:35.482623 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.482630 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.483468 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.483469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.484343 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.484347 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.484790 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.484792 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.484947 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.485641 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:35.485641 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:35.485678 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:35.485707 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:35.485910 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:35.485918 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:35.485922 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:35.486013 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 21:02:35.486138 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":125,"threads_started":1}
I20260812 21:02:35.487136 10680 heartbeater.cc:347] Connected to a master server at 127.10.30.126:44083
I20260812 21:02:35.487260 10680 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:35.487552 10680 heartbeater.cc:511] Master 127.10.30.126:44083 requested a full tablet report, sending...
I20260812 21:02:35.487792 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10482
I20260812 21:02:35.487943 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:02:35.488093 9950 ts_manager.cc:194] Registered new tserver with Master: 89b8e43379fc4939821f0206056688ec (127.10.30.67:46195)
I20260812 21:02:35.488227 10361 external_mini_cluster.cc:1428] Setting key 9ad10aad392341a5e97a8ade7ecb7364
I20260812 21:02:35.488579 9950 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.67:40243
I20260812 21:02:35.489599 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:02:35.494809 10018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.491402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.10.30.126:44083)
0812 21:02:35.491447 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.491449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.491644 (+ 195us) server_negotiation.cc:407] Connection header received
0812 21:02:35.491671 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.491672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.491689 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.491732 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:35.491886 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.492421 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.493300 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.493512 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.493573 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.494442 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:35.494464 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:35.494464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:35.494470 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:35.494485 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:35.494489 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:35.494597 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.494694 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.494707 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 21:02:35.497015 9949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:02:35.498974 9949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:02:35.506538 10700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.501877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:43627 (local address 127.0.0.1:39046)
0812 21:02:35.502737 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.502750 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:35.502820 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:35.503140 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:35.503141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:35.503143 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:35.503181 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.503182 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.504552 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.504553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.505422 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.505425 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.506205 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.506206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.506287 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.506302 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 21:02:35.506375 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 21:02:35.506441 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":845,"mutex_wait_us":470,"thread_start_us":75,"threads_started":1}
I20260812 21:02:35.506554 10701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.502414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39046 (local address 127.10.30.66:43627)
0812 21:02:35.502687 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.502691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.502821 (+ 130us) server_negotiation.cc:407] Connection header received
0812 21:02:35.502906 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.502908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.502928 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.503039 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:35.503270 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.504453 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.505518 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.506101 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.506193 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.506314 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.506390 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.506438 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":113,"threads_started":1}
I20260812 21:02:35.506803 10694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.501870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:46195 (local address 127.0.0.1:35362)
0812 21:02:35.502093 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.502130 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:35.502219 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:35.502843 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:35.502847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:35.502850 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:35.502949 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.502951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.504442 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.504443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.505512 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.505515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.506530 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.506531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.506596 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.506599 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 21:02:35.506644 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 21:02:35.506697 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":87,"threads_started":1}
I20260812 21:02:35.507154 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.502170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.10.30.67:46195)
0812 21:02:35.502538 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.502543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.502556 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:02:35.502607 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.502609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.502631 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.502730 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:35.503061 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.504275 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.505599 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.506336 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.506413 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.506500 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.506974 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.507053 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":90,"threads_started":1}
I20260812 21:02:35.507411 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.502046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42058 (local address 127.10.30.65:35151)
0812 21:02:35.502292 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.502297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.502509 (+ 212us) server_negotiation.cc:407] Connection header received
0812 21:02:35.502661 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.502664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.502683 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.502745 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:35.503069 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.503920 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.505361 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.506227 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.506319 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.506427 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.507252 (+ 825us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.507312 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":130,"threads_started":1}
I20260812 21:02:35.507551 10368 tablet_service.cc:1467] Processing CreateTablet for tablet cc103bc85e6543e58fb472870f672f36 (DEFAULT_TABLE table=test-table [id=e64498e259d84fbfb88fd0e31b29e880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:35.507928 10579 tablet_service.cc:1467] Processing CreateTablet for tablet cc103bc85e6543e58fb472870f672f36 (DEFAULT_TABLE table=test-table [id=e64498e259d84fbfb88fd0e31b29e880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:35.508092 10368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc103bc85e6543e58fb472870f672f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:35.508313 10579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc103bc85e6543e58fb472870f672f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:35.510931 10699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.501870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35151 (local address 127.0.0.1:42058)
0812 21:02:35.502436 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.502448 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:35.502542 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:35.502866 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:35.502867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:35.502870 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:35.502950 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.502954 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.504001 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.504001 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.505266 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.505269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.506470 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.506471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.506541 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.506546 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:02:35.506597 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 21:02:35.510821 (+ 4224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":383,"thread_start_us":55,"threads_started":1}
I20260812 21:02:35.511677 10703 tablet_bootstrap.cc:492] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Bootstrap starting.
I20260812 21:02:35.512048 10704 tablet_bootstrap.cc:492] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Bootstrap starting.
I20260812 21:02:35.511910 10144 tablet_service.cc:1467] Processing CreateTablet for tablet cc103bc85e6543e58fb472870f672f36 (DEFAULT_TABLE table=test-table [id=e64498e259d84fbfb88fd0e31b29e880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:35.512392 10144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc103bc85e6543e58fb472870f672f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:35.512462 10703 tablet_bootstrap.cc:654] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:35.512784 10703 log.cc:824] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:35.512837 10704 tablet_bootstrap.cc:654] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:35.513192 10704 log.cc:824] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:35.513703 10703 tablet_bootstrap.cc:492] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: No bootstrap required, opened a new log
I20260812 21:02:35.513805 10703 ts_tablet_manager.cc:1397] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 21:02:35.514055 10704 tablet_bootstrap.cc:492] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: No bootstrap required, opened a new log
I20260812 21:02:35.514128 10704 ts_tablet_manager.cc:1397] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 21:02:35.516083 10703 raft_consensus.cc:348] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.516265 10703 raft_consensus.cc:374] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:35.516314 10703 raft_consensus.cc:729] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89b8e43379fc4939821f0206056688ec, State: Initialized, Role: FOLLOWER
I20260812 21:02:35.516453 10703 consensus_queue.cc:260] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.516839 10703 ts_tablet_manager.cc:1428] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 21:02:35.516855 10680 heartbeater.cc:503] Master 127.10.30.126:44083 was elected leader, sending a full tablet report...
I20260812 21:02:35.517154 10704 raft_consensus.cc:348] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.517326 10704 raft_consensus.cc:374] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:35.517390 10704 raft_consensus.cc:729] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9cd20f3903413fba66c6e5643ea1d2, State: Initialized, Role: FOLLOWER
I20260812 21:02:35.517516 10704 consensus_queue.cc:260] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.517817 10704 ts_tablet_manager.cc:1428] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 21:02:35.517884 10476 heartbeater.cc:503] Master 127.10.30.126:44083 was elected leader, sending a full tablet report...
I20260812 21:02:35.518056 10708 tablet_bootstrap.cc:492] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85: Bootstrap starting.
I20260812 21:02:35.518971 10708 tablet_bootstrap.cc:654] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:35.519337 10708 log.cc:824] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:35.520255 10708 tablet_bootstrap.cc:492] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85: No bootstrap required, opened a new log
I20260812 21:02:35.520326 10708 ts_tablet_manager.cc:1397] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 21:02:35.522804 10708 raft_consensus.cc:348] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.522962 10708 raft_consensus.cc:374] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:35.522987 10708 raft_consensus.cc:729] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f7173592a444b482f5425af0045d85, State: Initialized, Role: FOLLOWER
I20260812 21:02:35.523170 10708 consensus_queue.cc:260] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.523427 10708 ts_tablet_manager.cc:1428] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260812 21:02:35.523495 10248 heartbeater.cc:503] Master 127.10.30.126:44083 was elected leader, sending a full tablet report...
W20260812 21:02:35.577054 10477 tablet.cc:2369] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:02:35.679967 10249 tablet.cc:2369] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:02:35.730546 10681 tablet.cc:2369] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:02:35.741477 10710 raft_consensus.cc:482] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:35.741674 10710 raft_consensus.cc:504] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.742252 10710 leader_election.cc:288] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89b8e43379fc4939821f0206056688ec (127.10.30.67:46195), d9f7173592a444b482f5425af0045d85 (127.10.30.65:35151)
I20260812 21:02:35.745460 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.742700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:60597 (local address 127.10.30.65:35151)
0812 21:02:35.742765 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.742767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.742864 (+ 97us) server_negotiation.cc:407] Connection header received
0812 21:02:35.742942 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.742943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.742958 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.743044 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:35.743214 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.743705 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.744687 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.745063 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.745146 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.745158 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.745325 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.745369 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 21:02:35.745478 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.742615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:44171 (local address 127.10.30.67:46195)
0812 21:02:35.742697 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.742700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.742711 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:02:35.742758 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.742759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.742768 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.742837 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:35.743039 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.743582 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.744610 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.745080 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.745166 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.745176 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.745337 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.745382 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 21:02:35.745465 10479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.742500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:46195 (local address 127.10.30.66:44171)
0812 21:02:35.742574 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.742593 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:35.742675 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:35.742841 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:35.742843 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:35.742844 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:35.742946 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.742949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.743666 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.743668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.744514 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.744517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.745172 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.745173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.745250 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.745254 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:35.745328 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 21:02:35.745378 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":33}
I20260812 21:02:35.745473 10715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.742500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35151 (local address 127.10.30.66:60597)
0812 21:02:35.742771 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.742781 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:35.742873 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:35.743053 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:35.743054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:35.743056 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:35.743140 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.743143 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.743790 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.743791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.744590 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:35.744592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.745157 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.745158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:35.745250 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.745254 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:35.745318 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 21:02:35.745362 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":16,"thread_start_us":160,"threads_started":1}
I20260812 21:02:35.745916 10607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc103bc85e6543e58fb472870f672f36" candidate_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89b8e43379fc4939821f0206056688ec" is_pre_election: true
I20260812 21:02:35.745899 10179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc103bc85e6543e58fb472870f672f36" candidate_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9f7173592a444b482f5425af0045d85" is_pre_election: true
I20260812 21:02:35.746111 10607 raft_consensus.cc:2454] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c9cd20f3903413fba66c6e5643ea1d2 in term 0.
I20260812 21:02:35.746111 10179 raft_consensus.cc:2454] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c9cd20f3903413fba66c6e5643ea1d2 in term 0.
I20260812 21:02:35.746380 10284 leader_election.cc:302] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9cd20f3903413fba66c6e5643ea1d2, 89b8e43379fc4939821f0206056688ec; no voters:
I20260812 21:02:35.746532 10710 raft_consensus.cc:2781] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:02:35.746595 10710 raft_consensus.cc:482] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:02:35.746619 10710 raft_consensus.cc:3037] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:35.747642 10710 raft_consensus.cc:504] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.747799 10710 leader_election.cc:288] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [CANDIDATE]: Term 1 election: Requested vote from peers 89b8e43379fc4939821f0206056688ec (127.10.30.67:46195), d9f7173592a444b482f5425af0045d85 (127.10.30.65:35151)
I20260812 21:02:35.747974 10607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc103bc85e6543e58fb472870f672f36" candidate_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89b8e43379fc4939821f0206056688ec"
I20260812 21:02:35.748044 10179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc103bc85e6543e58fb472870f672f36" candidate_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9f7173592a444b482f5425af0045d85"
I20260812 21:02:35.748126 10179 raft_consensus.cc:3037] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:35.748131 10607 raft_consensus.cc:3037] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:35.749145 10179 raft_consensus.cc:2454] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c9cd20f3903413fba66c6e5643ea1d2 in term 1.
I20260812 21:02:35.749177 10607 raft_consensus.cc:2454] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c9cd20f3903413fba66c6e5643ea1d2 in term 1.
I20260812 21:02:35.749385 10280 leader_election.cc:302] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9cd20f3903413fba66c6e5643ea1d2, d9f7173592a444b482f5425af0045d85; no voters:
I20260812 21:02:35.749507 10710 raft_consensus.cc:2781] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:35.749701 10710 raft_consensus.cc:686] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 1 LEADER]: Becoming Leader. State: Replica: 7c9cd20f3903413fba66c6e5643ea1d2, State: Running, Role: LEADER
I20260812 21:02:35.749816 10710 consensus_queue.cc:237] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } }
I20260812 21:02:35.750833 9949 catalog_manager.cc:5495] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c9cd20f3903413fba66c6e5643ea1d2 (127.10.30.66). New cstate: current_term: 1 leader_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c9cd20f3903413fba66c6e5643ea1d2" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 43627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 } health_report { overall_health: UNKNOWN } } }
I20260812 21:02:35.798020 10701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.795210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.10.30.66:43627)
0812 21:02:35.795304 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:35.795306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:35.795317 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:02:35.795371 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:35.795372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:35.795416 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:35.795534 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:02:35.795715 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.796275 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.797099 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:35.797308 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:35.797384 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:35.797584 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:02:35.797694 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:02:35.797811 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:35.797867 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 21:02:35.797881 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 21:02:35.800611 10179 raft_consensus.cc:1261] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85 [term 1 FOLLOWER]: Refusing update from remote peer 7c9cd20f3903413fba66c6e5643ea1d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:35.800609 10607 raft_consensus.cc:1261] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 1 FOLLOWER]: Refusing update from remote peer 7c9cd20f3903413fba66c6e5643ea1d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:35.801097 10710 consensus_queue.cc:1035] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9f7173592a444b482f5425af0045d85" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:35.801292 10716 consensus_queue.cc:1035] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89b8e43379fc4939821f0206056688ec" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 46195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:35.804877 10720 mvcc.cc:205] Tried to move back new op lower bound from 7317784804555501568 to 7317784804351860736. Current Snapshot: MvccSnapshot[applied={T|T < 7317784804555501568}]
I20260812 21:02:35.807883 9949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:35.808007 9949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:35.809098 9949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2dd1d789aee74246bcb0a10f5984907a: Sending DeleteTablet for 3 replicas of tablet cc103bc85e6543e58fb472870f672f36
I20260812 21:02:35.809568 10579 tablet_service.cc:1514] Processing DeleteTablet for tablet cc103bc85e6543e58fb472870f672f36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:35 UTC) from {username='slave'} at 127.0.0.1:35362
I20260812 21:02:35.809553 10144 tablet_service.cc:1514] Processing DeleteTablet for tablet cc103bc85e6543e58fb472870f672f36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:35 UTC) from {username='slave'} at 127.0.0.1:42058
I20260812 21:02:35.809966 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10046
I20260812 21:02:35.809985 10735 tablet_replica.cc:330] T cc103bc85e6543e58fb472870f672f36 P d9f7173592a444b482f5425af0045d85: stopping tablet replica
I20260812 21:02:35.809986 10368 tablet_service.cc:1514] Processing DeleteTablet for tablet cc103bc85e6543e58fb472870f672f36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:35 UTC) from {username='slave'} at 127.0.0.1:39046
I20260812 21:02:35.816915 10739 tablet_replica.cc:330] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: stopping tablet replica
I20260812 21:02:35.817099 10739 raft_consensus.cc:2229] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:02:35.817231 10739 raft_consensus.cc:2258] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:35.823625 10739 ts_tablet_manager.cc:1905] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:35.826331 10739 ts_tablet_manager.cc:1918] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:35.826439 10739 log.cc:1196] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/cc103bc85e6543e58fb472870f672f36
I20260812 21:02:35.826743 10739 ts_tablet_manager.cc:1939] T cc103bc85e6543e58fb472870f672f36 P 7c9cd20f3903413fba66c6e5643ea1d2: Deleting consensus metadata
I20260812 21:02:35.828069 9926 catalog_manager.cc:4841] TS 7c9cd20f3903413fba66c6e5643ea1d2 (127.10.30.66:43627): tablet cc103bc85e6543e58fb472870f672f36 (table test-table [id=e64498e259d84fbfb88fd0e31b29e880]) successfully deleted
I20260812 21:02:35.834353 10738 tablet_replica.cc:330] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: stopping tablet replica
I20260812 21:02:35.834532 10738 raft_consensus.cc:2229] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:02:35.834663 10738 raft_consensus.cc:2258] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:35.836556 10738 ts_tablet_manager.cc:1905] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:35.839368 10738 ts_tablet_manager.cc:1918] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:35.839476 10738 log.cc:1196] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/cc103bc85e6543e58fb472870f672f36
I20260812 21:02:35.839759 10738 ts_tablet_manager.cc:1939] T cc103bc85e6543e58fb472870f672f36 P 89b8e43379fc4939821f0206056688ec: Deleting consensus metadata
I20260812 21:02:35.842082 9927 catalog_manager.cc:4841] TS 89b8e43379fc4939821f0206056688ec (127.10.30.67:46195): tablet cc103bc85e6543e58fb472870f672f36 (table test-table [id=e64498e259d84fbfb88fd0e31b29e880]) successfully deleted
W20260812 21:02:35.853163 9925 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:35151 (error 108)
I20260812 21:02:35.853425 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10251
I20260812 21:02:35.853952 10699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:35.853782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35151 (local address 127.0.0.1:42072)
0812 21:02:35.853854 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:35.853900 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 21:02:35.860785 9925 catalog_manager.cc:4584] TS d9f7173592a444b482f5425af0045d85 (127.10.30.65:35151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cc103bc85e6543e58fb472870f672f36: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35151: connect: Connection refused (error 111)
I20260812 21:02:35.872622 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10482
I20260812 21:02:35.899574 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 9899
2026-08-12T21:02:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1113 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:35 dist-test-slave-h3ft krb5kdc[10749](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:35 dist-test-slave-h3ft krb5kdc[10749](info): set up 2 sockets
Aug 12 21:02:35 dist-test-slave-h3ft krb5kdc[10749](info): commencing operation
krb5kdc: starting...
W20260812 21:02:37.273910 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:37 dist-test-slave-h3ft krb5kdc[10749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:02:37.431092 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:36355
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:43021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:36355
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:37.531769 10772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:37.532015 10772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:37.532039 10772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:37.533275 10772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:37.533334 10772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:37.533349 10772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:37.533361 10772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:37.533375 10772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:37.534994 10772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:36355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:36355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:37.535364 10772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:37.535622 10772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:37.541216 10786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:37.541293 10780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:37.541230 10781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:37.542186 10772 server_base.cc:1034] running on GCE node
I20260812 21:02:37.542580 10772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:37.542979 10772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:37.544243 10772 hybrid_clock.cc:648] HybridClock initialized: now 1786568557544206 us; error 68 us; skew 500 ppm
Aug 12 21:02:37 dist-test-slave-h3ft krb5kdc[10749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:37.547623 10772 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:02:37.548220 10772 webserver.cc:460] Webserver started at http://127.10.30.126:43413/ using document root <none> and password file <none>
I20260812 21:02:37.548550 10772 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:37.548629 10772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:37.548810 10772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:37.550179 10772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "0c931985674149628157d84e8f58dc0d"
format_stamp: "Formatted at 2026-08-12 21:02:37 on dist-test-slave-h3ft"
server_key: "8c9c701f0351dffffdc499b3c74ede37"
server_key_iv: "63d300e7a167ad778630669267ed4afa"
server_key_version: "encryptionkey@0"
I20260812 21:02:37.550631 10772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "0c931985674149628157d84e8f58dc0d"
format_stamp: "Formatted at 2026-08-12 21:02:37 on dist-test-slave-h3ft"
server_key: "8c9c701f0351dffffdc499b3c74ede37"
server_key_iv: "63d300e7a167ad778630669267ed4afa"
server_key_version: "encryptionkey@0"
I20260812 21:02:37.552418 10772 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 21:02:37.553457 10796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:37.553838 10772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:37.553995 10772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "0c931985674149628157d84e8f58dc0d"
format_stamp: "Formatted at 2026-08-12 21:02:37 on dist-test-slave-h3ft"
server_key: "8c9c701f0351dffffdc499b3c74ede37"
server_key_iv: "63d300e7a167ad778630669267ed4afa"
server_key_version: "encryptionkey@0"
I20260812 21:02:37.554106 10772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:37.600416 10772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:37.603226 10772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:37.603470 10772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:37.609480 10772 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:36355
I20260812 21:02:37.609562 10879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:36355 every 8 connection(s)
I20260812 21:02:37.610087 10772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:37.610291 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10772
I20260812 21:02:37.610477 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:37.610853 10361 external_mini_cluster.cc:1428] Setting key a6b65a35297bf5d5d7eeb399ed64f41d
I20260812 21:02:37.611660 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:37.615619 10881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d: Bootstrap starting.
I20260812 21:02:37.616402 10881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:37.616797 10881 log.cc:824] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:37.617990 10881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d: No bootstrap required, opened a new log
Aug 12 21:02:37 dist-test-slave-h3ft krb5kdc[10749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:37.620409 10881 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c931985674149628157d84e8f58dc0d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36355 } }
I20260812 21:02:37.620596 10881 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:37.620639 10881 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c931985674149628157d84e8f58dc0d, State: Initialized, Role: FOLLOWER
I20260812 21:02:37.620838 10881 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c931985674149628157d84e8f58dc0d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36355 } }
I20260812 21:02:37.620949 10881 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:37.620992 10881 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:37.621054 10881 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:37.621874 10881 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c931985674149628157d84e8f58dc0d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36355 } }
I20260812 21:02:37.622002 10881 leader_election.cc:302] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c931985674149628157d84e8f58dc0d; no voters:
I20260812 21:02:37.622213 10881 leader_election.cc:288] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:37.622359 10888 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:37.622527 10881 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:37.622634 10888 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [term 1 LEADER]: Becoming Leader. State: Replica: 0c931985674149628157d84e8f58dc0d, State: Running, Role: LEADER
I20260812 21:02:37.622779 10888 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c931985674149628157d84e8f58dc0d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36355 } }
I20260812 21:02:37.623376 10890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c931985674149628157d84e8f58dc0d. Latest consensus state: current_term: 1 leader_uuid: "0c931985674149628157d84e8f58dc0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c931985674149628157d84e8f58dc0d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36355 } } }
I20260812 21:02:37.623507 10890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:37.623481 10893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c931985674149628157d84e8f58dc0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c931985674149628157d84e8f58dc0d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36355 } } }
I20260812 21:02:37.624013 10893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:37.624033 10904 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:37.624752 10904 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:37.625357 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:37.611693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.10.30.126:36355)
0812 21:02:37.611955 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:37.611965 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:37.612006 (+ 41us) server_negotiation.cc:407] Connection header received
0812 21:02:37.612587 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:37.612595 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:37.612653 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:37.612852 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:37.613780 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:37.614905 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:37.616104 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:37.616642 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:37.616746 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:37.620200 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:37.620206 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:37.620207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:37.620224 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:37.622721 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:37.623553 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:37.623556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:37.623557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:37.623697 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:37.624011 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:37.624012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:37.624012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:37.624434 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:37.624621 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:37.625005 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 21:02:37.625166 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":133,"threads_started":1}
I20260812 21:02:37.627038 10904 catalog_manager.cc:1347] Generated new cluster ID: 2f66fb5e152f434a8c765f3d53e036b6
I20260812 21:02:37.627103 10904 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:37.640117 10904 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:37.640816 10904 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:37.648672 10904 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d: Generated new TSK 0
I20260812 21:02:37.648936 10904 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.30.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
Entry for principal kudu/127.10.30.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab.
I20260812 21:02:37.691660 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36355
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:43021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:37.794044 10924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:37.794314 10924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:37.794344 10924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:37.795621 10924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:37.795666 10924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:37.795693 10924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:02:37.797212 10924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.65.keytab
--principal=kudu/127.10.30.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:37.797464 10924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:37.797691 10924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:37.803925 10937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:37.803977 10936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:37.803937 10941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:37.804344 10924 server_base.cc:1034] running on GCE node
I20260812 21:02:37.804611 10924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:37.804939 10924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:37.806219 10924 hybrid_clock.cc:648] HybridClock initialized: now 1786568557806184 us; error 48 us; skew 500 ppm
Aug 12 21:02:37 dist-test-slave-h3ft krb5kdc[10749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:37.809850 10924 init.cc:377] Logged in from keytab as kudu/127.10.30.65@KRBTEST.COM (short username kudu)
I20260812 21:02:37.810444 10924 webserver.cc:460] Webserver started at http://127.10.30.65:38065/ using document root <none> and password file <none>
I20260812 21:02:37.810737 10924 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:37.810793 10924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:37.810957 10924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:37.812319 10924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "a711a59578034eb9b677700998be8542"
format_stamp: "Formatted at 2026-08-12 21:02:37 on dist-test-slave-h3ft"
server_key: "e0e635d9617b1c9a4d80498d2eedb5b3"
server_key_iv: "b3d3aa385aa6a882b6ae564df3152e4b"
server_key_version: "encryptionkey@0"
I20260812 21:02:37.812799 10924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "a711a59578034eb9b677700998be8542"
format_stamp: "Formatted at 2026-08-12 21:02:37 on dist-test-slave-h3ft"
server_key: "e0e635d9617b1c9a4d80498d2eedb5b3"
server_key_iv: "b3d3aa385aa6a882b6ae564df3152e4b"
server_key_version: "encryptionkey@0"
I20260812 21:02:37.814502 10924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 21:02:37.815614 10954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:37.815973 10924 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 21:02:37.816112 10924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "a711a59578034eb9b677700998be8542"
format_stamp: "Formatted at 2026-08-12 21:02:37 on dist-test-slave-h3ft"
server_key: "e0e635d9617b1c9a4d80498d2eedb5b3"
server_key_iv: "b3d3aa385aa6a882b6ae564df3152e4b"
server_key_version: "encryptionkey@0"
I20260812 21:02:37.816207 10924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:37.844110 10924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:37.847486 10924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:37.847698 10924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:37.848160 10924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:37.848711 10924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:37.848755 10924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:37.848783 10924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:37.848796 10924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:37.857554 10924 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:42785
I20260812 21:02:37.857842 11128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:42785 every 8 connection(s)
I20260812 21:02:37.858160 10924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:02:37.860435 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 10924
I20260812 21:02:37.860616 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:02:37.860917 10361 external_mini_cluster.cc:1428] Setting key cacc1ff34b5136b067aa63a704c79f99
Aug 12 21:02:37 dist-test-slave-h3ft krb5kdc[10749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.65@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:37.870854 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:37.859240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:60015 (local address 127.10.30.126:36355)
0812 21:02:37.859314 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:37.859317 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:37.859611 (+ 294us) server_negotiation.cc:407] Connection header received
0812 21:02:37.860221 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:37.860222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:37.860236 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:37.860332 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:37.861845 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:37.862463 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:37.863926 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:37.864180 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:37.864292 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:37.867286 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:37.867288 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:37.867289 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:37.867306 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:37.869125 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:37.869660 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:37.869661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:37.869662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:37.869731 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:37.870024 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:37.870026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:37.870026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:37.870171 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:37.870253 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:37.870610 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 21:02:37.870738 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 21:02:37.871145 11134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:37.859150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36355 (local address 127.10.30.65:60015)
0812 21:02:37.859401 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:37.859452 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:37.860061 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:37.860456 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:37.860461 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:37.861402 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:37.861684 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:37.861690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:37.862616 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:37.862618 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:37.863798 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:37.863803 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:37.864327 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:37.864329 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:37.864498 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:37.865294 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:37.865305 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:37.867166 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:37.869254 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:37.869268 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:37.869271 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:37.869568 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:37.869807 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:37.869808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:37.869809 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:37.869946 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:37.870242 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:37.870251 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:37.870431 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 21:02:37.870576 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 21:02:37.870810 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":158,"threads_started":1}
WARNING: no policy specified for kudu/127.10.30.66@KRBTEST.COM; defaulting to no policy
I20260812 21:02:37.871901 11129 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36355
I20260812 21:02:37.872043 11129 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:37.872267 11129 heartbeater.cc:511] Master 127.10.30.126:36355 requested a full tablet report, sending...
I20260812 21:02:37.872967 10828 ts_manager.cc:194] Registered new tserver with Master: a711a59578034eb9b677700998be8542 (127.10.30.65:42785)
I20260812 21:02:37.873670 10828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.65@KRBTEST.COM'} at 127.10.30.65:60015
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
Entry for principal kudu/127.10.30.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab.
I20260812 21:02:37.895457 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36355
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:43021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:37.995493 11138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:37.995754 11138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:37.995781 11138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:37.997025 11138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:37.997079 11138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:37.997107 11138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:02:37.998649 11138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.66.keytab
--principal=kudu/127.10.30.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:37.998876 11138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:37.999163 11138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:38.005812 11150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:38.005913 11158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:38.005858 11152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:38.006350 11138 server_base.cc:1034] running on GCE node
I20260812 21:02:38.006649 11138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:38.006954 11138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:38.008173 11138 hybrid_clock.cc:648] HybridClock initialized: now 1786568558008148 us; error 54 us; skew 500 ppm
Aug 12 21:02:38 dist-test-slave-h3ft krb5kdc[10749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568558, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:38.011667 11138 init.cc:377] Logged in from keytab as kudu/127.10.30.66@KRBTEST.COM (short username kudu)
I20260812 21:02:38.012249 11138 webserver.cc:460] Webserver started at http://127.10.30.66:43341/ using document root <none> and password file <none>
I20260812 21:02:38.012517 11138 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:38.012610 11138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:38.012791 11138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:38.014003 11138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "deec201c82eb4377b71e382315146d29"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "d187e26ea52c5164ad5c182779ab5122"
server_key_iv: "b24205d29f15671e2e68816ac097af55"
server_key_version: "encryptionkey@0"
I20260812 21:02:38.014410 11138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "deec201c82eb4377b71e382315146d29"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "d187e26ea52c5164ad5c182779ab5122"
server_key_iv: "b24205d29f15671e2e68816ac097af55"
server_key_version: "encryptionkey@0"
I20260812 21:02:38.016227 11138 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 21:02:38.017364 11169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:38.017741 11138 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:38.017907 11138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "deec201c82eb4377b71e382315146d29"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "d187e26ea52c5164ad5c182779ab5122"
server_key_iv: "b24205d29f15671e2e68816ac097af55"
server_key_version: "encryptionkey@0"
I20260812 21:02:38.018002 11138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:38.036248 11138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:38.038856 11138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:38.039090 11138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:38.039397 11138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:38.039770 11138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:38.039842 11138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:38.039891 11138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:38.039935 11138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:38.048218 11138 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:35303
I20260812 21:02:38.048316 11371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:35303 every 8 connection(s)
I20260812 21:02:38.048705 11138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:02:38.053989 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 11138
I20260812 21:02:38.054176 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:02:38.054487 10361 external_mini_cluster.cc:1428] Setting key fbadc8448f067b4e8776320d53817b08
Aug 12 21:02:38 dist-test-slave-h3ft krb5kdc[10749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568558, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.66@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:38.062840 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.049792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:49415 (local address 127.10.30.126:36355)
0812 21:02:38.049912 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.049915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.050092 (+ 177us) server_negotiation.cc:407] Connection header received
0812 21:02:38.050759 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.050761 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.050775 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.050859 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:38.052141 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.052729 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.054391 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.054645 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.054749 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.058475 (+ 3726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:38.058478 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:38.058479 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:38.058490 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:38.060423 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:38.061182 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:38.061184 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:38.061185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:38.061308 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:38.061855 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:38.061856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:38.061856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:38.062026 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:38.062155 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.062608 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.062751 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 21:02:38.063333 11374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.049682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36355 (local address 127.10.30.66:49415)
0812 21:02:38.049900 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:38.049951 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:38.050604 (+ 653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:38.051021 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:38.051027 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:38.051746 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:38.052012 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.052017 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.052883 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.052884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.054239 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.054244 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.054788 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.054789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.054940 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.055885 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:38.055898 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:38.058333 (+ 2435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:38.060559 (+ 2226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:38.060577 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:38.060580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:38.061040 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:38.061435 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:38.061436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:38.061436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:38.061636 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:38.062176 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:38.062185 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:38.062430 (+ 245us) client_negotiation.cc:769] Sending connection context
0812 21:02:38.062581 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 21:02:38.062859 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":82,"threads_started":1}
I20260812 21:02:38.064188 11372 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36355
I20260812 21:02:38.064361 11372 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:38.064667 11372 heartbeater.cc:511] Master 127.10.30.126:36355 requested a full tablet report, sending...
I20260812 21:02:38.065248 10828 ts_manager.cc:194] Registered new tserver with Master: deec201c82eb4377b71e382315146d29 (127.10.30.66:35303)
I20260812 21:02:38.065955 10828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.66@KRBTEST.COM'} at 127.10.30.66:49415
WARNING: no policy specified for kudu/127.10.30.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
Entry for principal kudu/127.10.30.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab.
I20260812 21:02:38.096385 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36355
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:43021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:38.209538 11382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:38.209896 11382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:38.209956 11382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:38.211602 11382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:38.211700 11382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:38.211766 11382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:02:38.213749 11382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:43021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.67.keytab
--principal=kudu/127.10.30.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:36355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:38.214124 11382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:38.214462 11382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:38.221480 11389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:38.221448 11393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:38.221448 11390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:38.221949 11382 server_base.cc:1034] running on GCE node
I20260812 21:02:38.222231 11382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:38.222631 11382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:38.223853 11382 hybrid_clock.cc:648] HybridClock initialized: now 1786568558223828 us; error 46 us; skew 500 ppm
Aug 12 21:02:38 dist-test-slave-h3ft krb5kdc[10749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568558, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:38.227339 11382 init.cc:377] Logged in from keytab as kudu/127.10.30.67@KRBTEST.COM (short username kudu)
I20260812 21:02:38.227946 11382 webserver.cc:460] Webserver started at http://127.10.30.67:37683/ using document root <none> and password file <none>
I20260812 21:02:38.228226 11382 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:38.228302 11382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:38.228483 11382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:38.229775 11382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "2e81eb49591449458c9e71567f50d4fe"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "15f4821ffb39be37d2ebbe53503948e6"
server_key_iv: "591fc173c718ceae2d4e11d70ca5c950"
server_key_version: "encryptionkey@0"
I20260812 21:02:38.230262 11382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "2e81eb49591449458c9e71567f50d4fe"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "15f4821ffb39be37d2ebbe53503948e6"
server_key_iv: "591fc173c718ceae2d4e11d70ca5c950"
server_key_version: "encryptionkey@0"
I20260812 21:02:38.232020 11382 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:02:38.233070 11414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:38.233389 11382 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:38.233547 11382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "2e81eb49591449458c9e71567f50d4fe"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "15f4821ffb39be37d2ebbe53503948e6"
server_key_iv: "591fc173c718ceae2d4e11d70ca5c950"
server_key_version: "encryptionkey@0"
I20260812 21:02:38.233644 11382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:38.249001 11382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:38.252004 11382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:38.252225 11382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:38.252593 11382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:38.253012 11382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:38.253074 11382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:38.253126 11382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:38.253176 11382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:38.262564 11382 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:36965
I20260812 21:02:38.262663 11611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:36965 every 8 connection(s)
I20260812 21:02:38.263235 11382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:02:38.265940 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 11382
I20260812 21:02:38.266065 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:02:38.266309 10361 external_mini_cluster.cc:1428] Setting key 3fdea835d113941df8c194797a1362cc
Aug 12 21:02:38 dist-test-slave-h3ft krb5kdc[10749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568558, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.67@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:02:38.275715 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.264408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:45891 (local address 127.10.30.126:36355)
0812 21:02:38.264557 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.264560 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.264779 (+ 219us) server_negotiation.cc:407] Connection header received
0812 21:02:38.265500 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.265502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.265517 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.265583 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:38.267049 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.267600 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.268706 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.268924 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.269010 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.271920 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:38.271922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:38.271922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:38.271931 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:38.273834 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:38.274420 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:38.274421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:38.274422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:38.274504 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:38.274831 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:38.274832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:38.274833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:38.275050 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:38.275158 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.275531 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.275626 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 21:02:38.275992 11614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.264302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36355 (local address 127.10.30.67:45891)
0812 21:02:38.264613 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:38.264672 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:38.265357 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:38.265714 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:38.265718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:38.266592 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:38.266907 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.266914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.267712 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.267713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.268605 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.268608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.269023 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.269024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.269175 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.269901 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:02:38.269912 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:38.271786 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:38.273984 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:38.274003 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:38.274006 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:38.274315 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:38.274590 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:02:38.274591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:02:38.274592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:02:38.274747 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:02:38.275180 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:38.275188 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:38.275361 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 21:02:38.275483 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 21:02:38.275673 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":136,"threads_started":1}
I20260812 21:02:38.276684 11612 heartbeater.cc:347] Connected to a master server at 127.10.30.126:36355
I20260812 21:02:38.276827 11612 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:38.277148 11612 heartbeater.cc:511] Master 127.10.30.126:36355 requested a full tablet report, sending...
I20260812 21:02:38.277760 10828 ts_manager.cc:194] Registered new tserver with Master: 2e81eb49591449458c9e71567f50d4fe (127.10.30.67:36965)
I20260812 21:02:38.278366 10828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.30.67@KRBTEST.COM'} at 127.10.30.67:45891
I20260812 21:02:38.278753 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:02:38.288028 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.280655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46580 (local address 127.10.30.126:36355)
0812 21:02:38.280738 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.280741 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.280821 (+ 80us) server_negotiation.cc:407] Connection header received
0812 21:02:38.280872 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.280872 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.280882 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.280997 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:38.281645 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.282210 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.283206 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.283419 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.283507 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.284993 (+ 1486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:38.284994 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:38.284995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:38.285002 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:38.286551 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:38.286946 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:38.286947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:38.286947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:38.287086 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:38.287295 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:38.287296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:38.287296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:38.287499 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:38.287590 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.287790 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.287873 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 21:02:38.290562 10828 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:02:38.292838 10828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:02:38.301173 11632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.296582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36092 (local address 127.10.30.66:35303)
0812 21:02:38.296819 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.296824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.297018 (+ 194us) server_negotiation.cc:407] Connection header received
0812 21:02:38.297071 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.297073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.297091 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.297165 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:38.297379 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.298606 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.300110 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.300654 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.300748 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.300825 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.301006 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.301059 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":142,"threads_started":1}
I20260812 21:02:38.301198 11625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.296186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:42785 (local address 127.0.0.1:48356)
0812 21:02:38.296444 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:38.296760 (+ 316us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:38.296813 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:38.297234 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:38.297236 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:38.297238 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:38.297301 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.297304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.298790 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.298791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.299823 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.299826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.300827 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.300828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.300911 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.300916 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:02:38.300952 (+ 36us) client_negotiation.cc:240] Negotiation successful
0812 21:02:38.301041 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":63,"threads_started":1}
I20260812 21:02:38.301400 11630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.296367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48356 (local address 127.10.30.65:42785)
0812 21:02:38.297051 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.297055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.297067 (+ 12us) server_negotiation.cc:407] Connection header received
0812 21:02:38.297120 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.297122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.297142 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.297238 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:38.297412 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.298614 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.299955 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.300701 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.301109 (+ 408us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.301185 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.301217 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.301277 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":129,"threads_started":1}
I20260812 21:02:38.301611 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.296204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:36965 (local address 127.0.0.1:57802)
0812 21:02:38.296627 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:38.296648 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:38.296735 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:38.297142 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:38.297146 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:38.297149 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:38.297250 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.297253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.298323 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.298325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.299649 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.299653 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.300917 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.300918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.300991 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.300995 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:38.301049 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 21:02:38.301100 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":164,"threads_started":1}
I20260812 21:02:38.301880 11626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.296204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:35303 (local address 127.0.0.1:36092)
0812 21:02:38.296897 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:38.296907 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:38.296960 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:38.297246 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:38.297247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:38.297249 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:38.297304 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.297305 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.298744 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.298745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.300009 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.300012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.300761 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.300762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.300858 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.300893 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 21:02:38.300986 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 21:02:38.301041 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":252,"spinlock_wait_cycles":1280,"thread_start_us":144,"threads_started":1}
I20260812 21:02:38.301934 11631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.296560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57802 (local address 127.10.30.67:36965)
0812 21:02:38.296928 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.296934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.296945 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:02:38.296998 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.297001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.297021 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.297340 (+ 319us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:38.297438 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.298201 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.299767 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.300703 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.300792 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.300879 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.301747 (+ 868us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.301829 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":119,"threads_started":1}
I20260812 21:02:38.302420 11029 tablet_service.cc:1467] Processing CreateTablet for tablet 7554c88934b04f34831a9318aa6d240e (DEFAULT_TABLE table=test-table [id=6c2d7d3ffb1a4712b0ee4135055272d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:38.302891 11029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7554c88934b04f34831a9318aa6d240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:38.302855 11263 tablet_service.cc:1467] Processing CreateTablet for tablet 7554c88934b04f34831a9318aa6d240e (DEFAULT_TABLE table=test-table [id=6c2d7d3ffb1a4712b0ee4135055272d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:38.303270 11263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7554c88934b04f34831a9318aa6d240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:38.306650 11633 tablet_bootstrap.cc:492] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542: Bootstrap starting.
I20260812 21:02:38.307183 11635 tablet_bootstrap.cc:492] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Bootstrap starting.
I20260812 21:02:38.307345 11500 tablet_service.cc:1467] Processing CreateTablet for tablet 7554c88934b04f34831a9318aa6d240e (DEFAULT_TABLE table=test-table [id=6c2d7d3ffb1a4712b0ee4135055272d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:38.307576 11633 tablet_bootstrap.cc:654] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:38.307802 11500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7554c88934b04f34831a9318aa6d240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:38.307969 11635 tablet_bootstrap.cc:654] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:38.308606 11635 log.cc:824] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:38.308717 11633 log.cc:824] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:38.309490 11635 tablet_bootstrap.cc:492] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: No bootstrap required, opened a new log
I20260812 21:02:38.309585 11635 ts_tablet_manager.cc:1397] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 21:02:38.311440 11633 tablet_bootstrap.cc:492] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542: No bootstrap required, opened a new log
I20260812 21:02:38.311504 11633 ts_tablet_manager.cc:1397] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260812 21:02:38.311404 11635 raft_consensus.cc:348] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.311630 11635 raft_consensus.cc:374] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:38.311678 11635 raft_consensus.cc:729] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deec201c82eb4377b71e382315146d29, State: Initialized, Role: FOLLOWER
I20260812 21:02:38.311810 11635 consensus_queue.cc:260] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.312158 11635 ts_tablet_manager.cc:1428] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:02:38.312182 11372 heartbeater.cc:503] Master 127.10.30.126:36355 was elected leader, sending a full tablet report...
I20260812 21:02:38.313762 11633 raft_consensus.cc:348] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.313973 11633 raft_consensus.cc:374] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:38.314025 11633 raft_consensus.cc:729] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a711a59578034eb9b677700998be8542, State: Initialized, Role: FOLLOWER
I20260812 21:02:38.314177 11633 consensus_queue.cc:260] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.314498 11633 ts_tablet_manager.cc:1428] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 21:02:38.314577 11129 heartbeater.cc:503] Master 127.10.30.126:36355 was elected leader, sending a full tablet report...
I20260812 21:02:38.314958 11639 tablet_bootstrap.cc:492] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Bootstrap starting.
I20260812 21:02:38.315889 11639 tablet_bootstrap.cc:654] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:38.316445 11639 log.cc:824] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:38.317507 11639 tablet_bootstrap.cc:492] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: No bootstrap required, opened a new log
I20260812 21:02:38.317584 11639 ts_tablet_manager.cc:1397] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:02:38.319466 11639 raft_consensus.cc:348] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.319631 11639 raft_consensus.cc:374] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:38.319655 11639 raft_consensus.cc:729] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e81eb49591449458c9e71567f50d4fe, State: Initialized, Role: FOLLOWER
I20260812 21:02:38.319805 11639 consensus_queue.cc:260] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.320178 11639 ts_tablet_manager.cc:1428] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 21:02:38.320288 11612 heartbeater.cc:503] Master 127.10.30.126:36355 was elected leader, sending a full tablet report...
W20260812 21:02:38.359248 11132 tablet.cc:2369] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:02:38.514199 11613 tablet.cc:2369] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:02:38.549686 11373 tablet.cc:2369] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:02:38.685245 11641 raft_consensus.cc:482] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:38.685451 11641 raft_consensus.cc:504] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.686022 11641 leader_election.cc:288] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a711a59578034eb9b677700998be8542 (127.10.30.65:42785), 2e81eb49591449458c9e71567f50d4fe (127.10.30.67:36965)
I20260812 21:02:38.689576 11630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.686328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:33633 (local address 127.10.30.65:42785)
0812 21:02:38.686399 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.686402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.686510 (+ 108us) server_negotiation.cc:407] Connection header received
0812 21:02:38.686594 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.686595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.686623 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.686708 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:38.686928 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.687515 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.688716 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.689135 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.689234 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.689248 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.689414 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.689460 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 21:02:38.689582 11631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.686441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:52177 (local address 127.10.30.67:36965)
0812 21:02:38.686544 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.686547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.686581 (+ 34us) server_negotiation.cc:407] Connection header received
0812 21:02:38.686623 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.686624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.686633 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.686702 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:38.686954 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.687522 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.688717 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.689178 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.689272 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.689284 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.689445 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.689501 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 21:02:38.689586 11651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.686223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:42785 (local address 127.10.30.66:33633)
0812 21:02:38.686414 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:38.686440 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:38.686523 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:38.686716 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:38.686717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:38.686719 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:38.686830 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.686833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.687615 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.687617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.688601 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.688603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.689234 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.689236 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.689322 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.689327 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:02:38.689407 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 21:02:38.689474 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":34,"thread_start_us":101,"threads_started":1}
I20260812 21:02:38.689599 11650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.686252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:36965 (local address 127.10.30.66:52177)
0812 21:02:38.686427 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:38.686439 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:38.686538 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:38.686710 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:38.686711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:38.686713 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:38.686867 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.686868 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.687617 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.687618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.688602 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:38.688606 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.689272 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.689273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:38.689360 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.689364 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:38.689435 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 21:02:38.689485 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":68,"thread_start_us":72,"threads_started":1}
I20260812 21:02:38.690099 11061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7554c88934b04f34831a9318aa6d240e" candidate_uuid: "deec201c82eb4377b71e382315146d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a711a59578034eb9b677700998be8542" is_pre_election: true
I20260812 21:02:38.690248 11528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7554c88934b04f34831a9318aa6d240e" candidate_uuid: "deec201c82eb4377b71e382315146d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e81eb49591449458c9e71567f50d4fe" is_pre_election: true
I20260812 21:02:38.690341 11061 raft_consensus.cc:2454] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deec201c82eb4377b71e382315146d29 in term 0.
I20260812 21:02:38.690462 11528 raft_consensus.cc:2454] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deec201c82eb4377b71e382315146d29 in term 0.
I20260812 21:02:38.690727 11175 leader_election.cc:302] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2e81eb49591449458c9e71567f50d4fe, a711a59578034eb9b677700998be8542, deec201c82eb4377b71e382315146d29; no voters:
I20260812 21:02:38.690897 11641 raft_consensus.cc:2781] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:02:38.690973 11641 raft_consensus.cc:482] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:02:38.691025 11641 raft_consensus.cc:3037] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:38.692019 11641 raft_consensus.cc:504] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.692211 11641 leader_election.cc:288] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [CANDIDATE]: Term 1 election: Requested vote from peers a711a59578034eb9b677700998be8542 (127.10.30.65:42785), 2e81eb49591449458c9e71567f50d4fe (127.10.30.67:36965)
I20260812 21:02:38.692415 11061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7554c88934b04f34831a9318aa6d240e" candidate_uuid: "deec201c82eb4377b71e382315146d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a711a59578034eb9b677700998be8542"
I20260812 21:02:38.692463 11528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7554c88934b04f34831a9318aa6d240e" candidate_uuid: "deec201c82eb4377b71e382315146d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e81eb49591449458c9e71567f50d4fe"
I20260812 21:02:38.692509 11061 raft_consensus.cc:3037] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:38.692625 11528 raft_consensus.cc:3037] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:38.693568 11061 raft_consensus.cc:2454] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deec201c82eb4377b71e382315146d29 in term 1.
I20260812 21:02:38.693663 11528 raft_consensus.cc:2454] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deec201c82eb4377b71e382315146d29 in term 1.
I20260812 21:02:38.693845 11175 leader_election.cc:302] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a711a59578034eb9b677700998be8542, deec201c82eb4377b71e382315146d29; no voters:
I20260812 21:02:38.694015 11641 raft_consensus.cc:2781] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:38.694254 11641 raft_consensus.cc:686] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 1 LEADER]: Becoming Leader. State: Replica: deec201c82eb4377b71e382315146d29, State: Running, Role: LEADER
I20260812 21:02:38.694423 11641 consensus_queue.cc:237] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } }
I20260812 21:02:38.695700 10828 catalog_manager.cc:5495] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 reported cstate change: term changed from 0 to 1, leader changed from <none> to deec201c82eb4377b71e382315146d29 (127.10.30.66). New cstate: current_term: 1 leader_uuid: "deec201c82eb4377b71e382315146d29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deec201c82eb4377b71e382315146d29" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 35303 } health_report { overall_health: HEALTHY } } }
I20260812 21:02:38.747946 11632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.745276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51854 (local address 127.10.30.66:35303)
0812 21:02:38.745346 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:38.745348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:38.745358 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:02:38.745409 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:38.745410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:38.745434 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:38.745511 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:02:38.745710 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.746250 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.747090 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:38.747303 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:38.747357 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:38.747527 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:02:38.747657 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:02:38.747730 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:38.747795 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 21:02:38.747818 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 21:02:38.750861 11061 raft_consensus.cc:1261] T 7554c88934b04f34831a9318aa6d240e P a711a59578034eb9b677700998be8542 [term 1 FOLLOWER]: Refusing update from remote peer deec201c82eb4377b71e382315146d29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:38.750862 11528 raft_consensus.cc:1261] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 1 FOLLOWER]: Refusing update from remote peer deec201c82eb4377b71e382315146d29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:38.751340 11641 consensus_queue.cc:1035] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e81eb49591449458c9e71567f50d4fe" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 36965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:38.751536 11652 consensus_queue.cc:1035] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a711a59578034eb9b677700998be8542" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 42785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:38.754441 11655 mvcc.cc:205] Tried to move back new op lower bound from 7317784816638812160 to 7317784816413372416. Current Snapshot: MvccSnapshot[applied={T|T < 7317784816638812160}]
I20260812 21:02:38.754750 11659 mvcc.cc:205] Tried to move back new op lower bound from 7317784816638812160 to 7317784816413372416. Current Snapshot: MvccSnapshot[applied={T|T < 7317784816638812160}]
I20260812 21:02:38.758567 10826 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:38.758693 10826 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:38.759737 10826 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c931985674149628157d84e8f58dc0d: Sending DeleteTablet for 3 replicas of tablet 7554c88934b04f34831a9318aa6d240e
I20260812 21:02:38.760123 11029 tablet_service.cc:1514] Processing DeleteTablet for tablet 7554c88934b04f34831a9318aa6d240e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:38 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:48356
I20260812 21:02:38.760162 11263 tablet_service.cc:1514] Processing DeleteTablet for tablet 7554c88934b04f34831a9318aa6d240e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:38 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:36092
I20260812 21:02:38.760456 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10924
I20260812 21:02:38.760593 11500 tablet_service.cc:1514] Processing DeleteTablet for tablet 7554c88934b04f34831a9318aa6d240e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:38 UTC) from {username='kudu', principal='kudu/127.10.30.126@KRBTEST.COM'} at 127.0.0.1:57802
I20260812 21:02:38.769800 11678 tablet_replica.cc:330] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: stopping tablet replica
I20260812 21:02:38.770042 11678 raft_consensus.cc:2229] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:02:38.770203 11678 raft_consensus.cc:2258] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:38.773559 11678 ts_tablet_manager.cc:1905] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:38.775233 11676 tablet_replica.cc:330] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: stopping tablet replica
I20260812 21:02:38.775513 11676 raft_consensus.cc:2229] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:02:38.775810 11676 raft_consensus.cc:2258] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:38.777280 11678 ts_tablet_manager.cc:1918] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:38.777423 11678 log.cc:1196] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/7554c88934b04f34831a9318aa6d240e
I20260812 21:02:38.777648 11676 ts_tablet_manager.cc:1905] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:38.777793 11678 ts_tablet_manager.cc:1939] T 7554c88934b04f34831a9318aa6d240e P 2e81eb49591449458c9e71567f50d4fe: Deleting consensus metadata
I20260812 21:02:38.778561 10804 catalog_manager.cc:4841] TS 2e81eb49591449458c9e71567f50d4fe (127.10.30.67:36965): tablet 7554c88934b04f34831a9318aa6d240e (table test-table [id=6c2d7d3ffb1a4712b0ee4135055272d4]) successfully deleted
I20260812 21:02:38.780032 11676 ts_tablet_manager.cc:1918] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:38.780133 11676 log.cc:1196] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/7554c88934b04f34831a9318aa6d240e
I20260812 21:02:38.780445 11676 ts_tablet_manager.cc:1939] T 7554c88934b04f34831a9318aa6d240e P deec201c82eb4377b71e382315146d29: Deleting consensus metadata
I20260812 21:02:38.781131 10800 catalog_manager.cc:4841] TS deec201c82eb4377b71e382315146d29 (127.10.30.66:35303): tablet 7554c88934b04f34831a9318aa6d240e (table test-table [id=6c2d7d3ffb1a4712b0ee4135055272d4]) successfully deleted
W20260812 21:02:38.786537 10798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:42785 (error 108)
I20260812 21:02:38.787153 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 11138
I20260812 21:02:38.787503 11626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:38.787323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:42785 (local address 127.0.0.1:52188)
0812 21:02:38.787393 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:38.787442 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:42785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 21:02:38.787634 10798 catalog_manager.cc:4584] TS a711a59578034eb9b677700998be8542 (127.10.30.65:42785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7554c88934b04f34831a9318aa6d240e: Network error: Client connection negotiation failed: client connection to 127.10.30.65:42785: connect: Connection refused (error 111)
I20260812 21:02:38.806686 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 11382
I20260812 21:02:38.825657 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 10772
2026-08-12T21:02:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2931 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T21:02:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:38Z Disabled control of system clock
I20260812 21:02:38.875276 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:38199
--webserver_interface=127.10.30.126
--webserver_port=0
--builtin_ntp_servers=127.10.30.84:42495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:38199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:38.973452 11683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:38.973809 11683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:38.973850 11683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:38.975275 11683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:38.975360 11683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:38.975382 11683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:38.975404 11683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:38.975452 11683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:38.976995 11683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:38199
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:38199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:38.977344 11683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:38.977720 11683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 21:02:38.984045 11683 server_base.cc:1034] running on GCE node
W20260812 21:02:38.984025 11691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:38.983994 11694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:38.984292 11692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:38.984696 11683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:38.985100 11683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:38.986269 11683 hybrid_clock.cc:648] HybridClock initialized: now 1786568558986243 us; error 41 us; skew 500 ppm
I20260812 21:02:38.995092 11683 webserver.cc:460] Webserver started at http://127.10.30.126:36263/ using document root <none> and password file <none>
I20260812 21:02:38.995492 11683 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:38.995558 11683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:38.995784 11683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:38.997299 11683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "9b2c56583c3d41259df4eeed6bc21e9b"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "973756aa473e1e76f195dfbabea3e9f1"
server_key_iv: "a01f5826aafdb4b316f63f53b24664db"
server_key_version: "encryptionkey@0"
I20260812 21:02:38.997790 11683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "9b2c56583c3d41259df4eeed6bc21e9b"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "973756aa473e1e76f195dfbabea3e9f1"
server_key_iv: "a01f5826aafdb4b316f63f53b24664db"
server_key_version: "encryptionkey@0"
I20260812 21:02:38.999953 11683 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:02:39.001271 11703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.001554 11683 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:39.001725 11683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "9b2c56583c3d41259df4eeed6bc21e9b"
format_stamp: "Formatted at 2026-08-12 21:02:38 on dist-test-slave-h3ft"
server_key: "973756aa473e1e76f195dfbabea3e9f1"
server_key_iv: "a01f5826aafdb4b316f63f53b24664db"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.001834 11683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:39.020210 11683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:39.020728 11683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:39.020941 11683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:39.026667 11683 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:38199
I20260812 21:02:39.026701 11786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:38199 every 8 connection(s)
I20260812 21:02:39.027271 11683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:39.028582 11788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:39.031565 11788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b: Bootstrap starting.
I20260812 21:02:39.032382 11788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:39.032361 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 11683
I20260812 21:02:39.032490 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:39.032794 10361 external_mini_cluster.cc:1428] Setting key bd1d7c806d14345cdbbff5909489c3db
I20260812 21:02:39.032853 11788 log.cc:824] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:39.033800 11788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b: No bootstrap required, opened a new log
I20260812 21:02:39.036566 11788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2c56583c3d41259df4eeed6bc21e9b" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 38199 } }
I20260812 21:02:39.036747 11788 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:39.036774 11788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b2c56583c3d41259df4eeed6bc21e9b, State: Initialized, Role: FOLLOWER
I20260812 21:02:39.036940 11788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2c56583c3d41259df4eeed6bc21e9b" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 38199 } }
I20260812 21:02:39.037034 11788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:39.037086 11788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:39.037138 11788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:39.037931 11788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2c56583c3d41259df4eeed6bc21e9b" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 38199 } }
I20260812 21:02:39.038082 11788 leader_election.cc:302] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b2c56583c3d41259df4eeed6bc21e9b; no voters:
I20260812 21:02:39.038367 11788 leader_election.cc:288] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:39.038525 11797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:39.038712 11797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [term 1 LEADER]: Becoming Leader. State: Replica: 9b2c56583c3d41259df4eeed6bc21e9b, State: Running, Role: LEADER
I20260812 21:02:39.038784 11788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:39.038910 11797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2c56583c3d41259df4eeed6bc21e9b" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 38199 } }
I20260812 21:02:39.039738 11796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.033551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48732 (local address 127.10.30.126:38199)
0812 21:02:39.033817 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.033825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.033945 (+ 120us) server_negotiation.cc:407] Connection header received
0812 21:02:39.034487 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.034495 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.034563 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.034742 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:39.035045 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.036037 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.037019 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.037571 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.037723 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.038737 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:39.038744 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:39.038744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:39.039059 (+ 315us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:39.039138 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:39.039157 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:39.039204 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.039353 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.039461 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":103,"threads_started":1}
I20260812 21:02:39.041085 11800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b2c56583c3d41259df4eeed6bc21e9b. Latest consensus state: current_term: 1 leader_uuid: "9b2c56583c3d41259df4eeed6bc21e9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2c56583c3d41259df4eeed6bc21e9b" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 38199 } } }
I20260812 21:02:39.041085 11799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b2c56583c3d41259df4eeed6bc21e9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2c56583c3d41259df4eeed6bc21e9b" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 38199 } } }
W20260812 21:02:39.041198 11820 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 21:02:39.041242 11800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:39.041247 11799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b [sys.catalog]: This master's current role is: LEADER
W20260812 21:02:39.041401 11820 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:02:39.043207 11822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:39.043484 11822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:39.045436 11822 catalog_manager.cc:1347] Generated new cluster ID: 227cf1a4aa3c4a8f8399538b4b334f86
I20260812 21:02:39.045521 11822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:39.052489 11822 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:39.053248 11822 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:39.058801 11822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b: Generated new TSK 0
I20260812 21:02:39.059190 11822 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:39.069628 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.65:0
--local_ip_for_outbound_sockets=127.10.30.65
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:38199
--builtin_ntp_servers=127.10.30.84:42495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:39.194882 11826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:39.195245 11826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:39.195276 11826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:39.196707 11826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:39.196763 11826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:39.196794 11826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.65
I20260812 21:02:39.198347 11826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.30.65
--webserver_port=0
--tserver_master_addrs=127.10.30.126:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.65
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:39.198679 11826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:39.199231 11826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:39.205545 11832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:39.205549 11833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:39.205729 11837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:39.206115 11826 server_base.cc:1034] running on GCE node
I20260812 21:02:39.206393 11826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:39.206799 11826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:39.207975 11826 hybrid_clock.cc:648] HybridClock initialized: now 1786568559207951 us; error 48 us; skew 500 ppm
I20260812 21:02:39.209774 11826 webserver.cc:460] Webserver started at http://127.10.30.65:38491/ using document root <none> and password file <none>
I20260812 21:02:39.210124 11826 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:39.210206 11826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:39.210371 11826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:39.211796 11826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/data/instance:
uuid: "5f6335d670ae4344950ba3fa492d3d5a"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "992ef68c9a8da023a419d559c73895d3"
server_key_iv: "29d2f7562a9e65770bfae9e78d8262df"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.212241 11826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance:
uuid: "5f6335d670ae4344950ba3fa492d3d5a"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "992ef68c9a8da023a419d559c73895d3"
server_key_iv: "29d2f7562a9e65770bfae9e78d8262df"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.213879 11826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:02:39.214829 11844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.215054 11826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:39.215190 11826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/wal
uuid: "5f6335d670ae4344950ba3fa492d3d5a"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "992ef68c9a8da023a419d559c73895d3"
server_key_iv: "29d2f7562a9e65770bfae9e78d8262df"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.215288 11826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:39.236179 11826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:39.236651 11826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:39.236836 11826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:39.237164 11826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:39.237591 11826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:39.237630 11826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.237658 11826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:39.237670 11826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.246079 11826 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.65:35873
I20260812 21:02:39.246146 12025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.65:35873 every 8 connection(s)
I20260812 21:02:39.246609 11826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/data/info.pb
I20260812 21:02:39.249621 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 11826
I20260812 21:02:39.249796 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-0/wal/instance
I20260812 21:02:39.250038 10361 external_mini_cluster.cc:1428] Setting key b304dca6b0a78a098e33ff73ed12bff9
I20260812 21:02:39.251451 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.66:0
--local_ip_for_outbound_sockets=127.10.30.66
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:38199
--builtin_ntp_servers=127.10.30.84:42495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 21:02:39.254451 11796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.247683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.65:52197 (local address 127.10.30.126:38199)
0812 21:02:39.247765 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.247768 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.248037 (+ 269us) server_negotiation.cc:407] Connection header received
0812 21:02:39.248806 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.248808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.248825 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.248892 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:39.249872 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.250735 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.252423 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.252647 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.252723 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.253991 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:39.253994 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:39.253995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:39.254004 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:39.254031 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:39.254037 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:39.254113 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.254270 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.254311 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 21:02:39.254637 12028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.247586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:38199 (local address 127.10.30.65:52197)
0812 21:02:39.247868 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.247913 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:39.248664 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:39.248991 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:39.248995 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:39.249006 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:39.249704 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.249710 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.250863 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.250864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.252286 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.252291 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.252757 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.252758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.252964 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.253743 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:39.253744 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:39.253798 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:39.253841 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:39.254146 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:39.254159 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:39.254163 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:39.254246 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 21:02:39.254375 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
I20260812 21:02:39.255388 12026 heartbeater.cc:347] Connected to a master server at 127.10.30.126:38199
I20260812 21:02:39.255533 12026 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:39.255808 12026 heartbeater.cc:511] Master 127.10.30.126:38199 requested a full tablet report, sending...
I20260812 21:02:39.256560 11724 ts_manager.cc:194] Registered new tserver with Master: 5f6335d670ae4344950ba3fa492d3d5a (127.10.30.65:35873)
I20260812 21:02:39.257315 11724 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.65:52197
W20260812 21:02:39.358565 12029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:39.358932 12029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:39.358978 12029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:39.360646 12029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:39.360800 12029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:39.360883 12029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.66
I20260812 21:02:39.362718 12029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.30.66
--webserver_port=0
--tserver_master_addrs=127.10.30.126:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.66
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:39.363128 12029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:39.363583 12029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:39.370321 12037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:39.370270 12036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:39.370596 12029 server_base.cc:1034] running on GCE node
W20260812 21:02:39.370343 12040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:39.370982 12029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:39.371405 12029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:39.372593 12029 hybrid_clock.cc:648] HybridClock initialized: now 1786568559372595 us; error 54 us; skew 500 ppm
I20260812 21:02:39.374431 12029 webserver.cc:460] Webserver started at http://127.10.30.66:42297/ using document root <none> and password file <none>
I20260812 21:02:39.374787 12029 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:39.374877 12029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:39.375138 12029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:39.376595 12029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/data/instance:
uuid: "95fd0c4e6a8d428c98b297b7a10fb81d"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "186b8c0dd0e1b9f4e4085d7c1c461529"
server_key_iv: "b10791ff91066e8aecc90056a3147e40"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.377074 12029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance:
uuid: "95fd0c4e6a8d428c98b297b7a10fb81d"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "186b8c0dd0e1b9f4e4085d7c1c461529"
server_key_iv: "b10791ff91066e8aecc90056a3147e40"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.378798 12029 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 21:02:39.379997 12048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.380215 12029 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:39.380340 12029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/wal
uuid: "95fd0c4e6a8d428c98b297b7a10fb81d"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "186b8c0dd0e1b9f4e4085d7c1c461529"
server_key_iv: "b10791ff91066e8aecc90056a3147e40"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.380452 12029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:39.401257 12029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:39.401759 12029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:39.401973 12029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:39.402315 12029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:39.402778 12029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:39.402851 12029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.402930 12029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:39.402966 12029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.412714 12029 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.66:40297
I20260812 21:02:39.412757 12232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.66:40297 every 8 connection(s)
I20260812 21:02:39.413218 12029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/data/info.pb
I20260812 21:02:39.420013 11796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.414362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:55197 (local address 127.10.30.126:38199)
0812 21:02:39.414476 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.414480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.414682 (+ 202us) server_negotiation.cc:407] Connection header received
0812 21:02:39.415525 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.415527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.415544 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.415600 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:39.416449 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.417021 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.418114 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.418323 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.418404 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.419592 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:39.419595 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:39.419595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:39.419603 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:39.419632 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:39.419637 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:39.419722 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.419857 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.419898 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 21:02:39.420295 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.414184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:38199 (local address 127.10.30.66:55197)
0812 21:02:39.414515 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.414577 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:39.415381 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:39.415686 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:39.415690 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:39.415708 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:39.416339 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.416343 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.417135 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.417136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.418011 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.418014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.418438 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.418439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.418596 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.419378 (+ 782us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:39.419378 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:39.419413 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:39.419442 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:39.419727 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:39.419736 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:39.419740 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 21:02:39.419856 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 21:02:39.419986 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":121,"threads_started":1}
I20260812 21:02:39.420853 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12029
I20260812 21:02:39.421032 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/wal/instance
I20260812 21:02:39.421064 12233 heartbeater.cc:347] Connected to a master server at 127.10.30.126:38199
I20260812 21:02:39.421217 12233 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:39.421355 10361 external_mini_cluster.cc:1428] Setting key 3241a627facb93dece227756366c3f03
I20260812 21:02:39.421504 12233 heartbeater.cc:511] Master 127.10.30.126:38199 requested a full tablet report, sending...
I20260812 21:02:39.422012 11723 ts_manager.cc:194] Registered new tserver with Master: 95fd0c4e6a8d428c98b297b7a10fb81d (127.10.30.66:40297)
I20260812 21:02:39.422647 11723 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.66:55197
I20260812 21:02:39.422802 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.30.67:0
--local_ip_for_outbound_sockets=127.10.30.67
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:38199
--builtin_ntp_servers=127.10.30.84:42495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 21:02:39.524554 12239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:39.524847 12239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:39.524874 12239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:39.526201 12239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:39.526247 12239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:39.526276 12239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.30.67
I20260812 21:02:39.527758 12239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.30.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.30.67
--webserver_port=0
--tserver_master_addrs=127.10.30.126:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.30.67
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:39.528044 12239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:39.528400 12239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:39.534811 12253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:39.534838 12257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:39.534838 12249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:39.535188 12239 server_base.cc:1034] running on GCE node
I20260812 21:02:39.535439 12239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:39.535733 12239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:39.536906 12239 hybrid_clock.cc:648] HybridClock initialized: now 1786568559536888 us; error 36 us; skew 500 ppm
I20260812 21:02:39.538597 12239 webserver.cc:460] Webserver started at http://127.10.30.67:40251/ using document root <none> and password file <none>
I20260812 21:02:39.538954 12239 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:39.539058 12239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:39.539242 12239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:39.540845 12239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/data/instance:
uuid: "368162237d0e4155a4996f7200b219b7"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "5da44b9549142bbd28e056fd449b64fb"
server_key_iv: "ed6755f37797883d9a5e97a2e79c7b7f"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.541286 12239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance:
uuid: "368162237d0e4155a4996f7200b219b7"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "5da44b9549142bbd28e056fd449b64fb"
server_key_iv: "ed6755f37797883d9a5e97a2e79c7b7f"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.542949 12239 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 21:02:39.544013 12263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.544291 12239 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:39.544442 12239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/wal
uuid: "368162237d0e4155a4996f7200b219b7"
format_stamp: "Formatted at 2026-08-12 21:02:39 on dist-test-slave-h3ft"
server_key: "5da44b9549142bbd28e056fd449b64fb"
server_key_iv: "ed6755f37797883d9a5e97a2e79c7b7f"
server_key_version: "encryptionkey@0"
I20260812 21:02:39.544538 12239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:39.563331 12239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:39.563794 12239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:39.563982 12239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:39.564296 12239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 21:02:39.564723 12239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 21:02:39.564781 12239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.564833 12239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 21:02:39.564864 12239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:39.572584 12239 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.67:40775
I20260812 21:02:39.572625 12444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.67:40775 every 8 connection(s)
I20260812 21:02:39.573066 12239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/data/info.pb
I20260812 21:02:39.579648 11796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.574102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.67:50545 (local address 127.10.30.126:38199)
0812 21:02:39.574196 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.574201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.574531 (+ 330us) server_negotiation.cc:407] Connection header received
0812 21:02:39.575282 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.575283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.575298 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.575362 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:39.576237 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.576834 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.577913 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.578136 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.578202 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.579345 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:39.579347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:39.579348 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:39.579354 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:39.579374 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:39.579379 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:39.579442 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.579535 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.579566 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 21:02:39.579859 12449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.574103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:38199 (local address 127.10.30.67:50545)
0812 21:02:39.574381 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.574424 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:39.575166 (+ 742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:39.575465 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:39.575469 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:39.575479 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:02:39.576145 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.576151 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.576956 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.576957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.577819 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.577822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.578240 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.578241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.578382 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.579136 (+ 754us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 21:02:39.579137 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:02:39.579172 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 21:02:39.579199 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:02:39.579452 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:02:39.579458 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:02:39.579460 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 21:02:39.579519 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 21:02:39.579622 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":131,"threads_started":1}
I20260812 21:02:39.580572 12446 heartbeater.cc:347] Connected to a master server at 127.10.30.126:38199
I20260812 21:02:39.580689 12446 heartbeater.cc:464] Registering TS with master...
I20260812 21:02:39.580993 12446 heartbeater.cc:511] Master 127.10.30.126:38199 requested a full tablet report, sending...
I20260812 21:02:39.581095 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12239
I20260812 21:02:39.581223 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/wal/instance
I20260812 21:02:39.581511 10361 external_mini_cluster.cc:1428] Setting key 778e61bf633e019702ca7cd76eb14ed1
I20260812 21:02:39.581538 11723 ts_manager.cc:194] Registered new tserver with Master: 368162237d0e4155a4996f7200b219b7 (127.10.30.67:40775)
I20260812 21:02:39.582284 11723 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.30.67:50545
I20260812 21:02:39.582551 10361 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 21:02:39.587693 11796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.584463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48746 (local address 127.10.30.126:38199)
0812 21:02:39.584532 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.584535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.584635 (+ 100us) server_negotiation.cc:407] Connection header received
0812 21:02:39.584696 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.584697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.584707 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.584750 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:39.584999 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.585519 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.586336 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.586547 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.586613 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.587400 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:39.587402 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:39.587403 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:39.587408 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:39.587426 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:39.587431 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:39.587484 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.587541 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.587565 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 21:02:39.589876 11724 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48746:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 21:02:39.592126 11724 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 21:02:39.600266 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.595574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.66:40297 (local address 127.0.0.1:51826)
0812 21:02:39.595947 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.595962 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:39.596029 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:39.596606 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:39.596610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:39.596613 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:39.596722 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.596727 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.597738 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.597739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.598905 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.598908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.599858 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.599859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.599968 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.599990 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 21:02:39.600078 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 21:02:39.600156 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":6,"thread_start_us":141,"threads_started":1}
I20260812 21:02:39.600277 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.595721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51826 (local address 127.10.30.66:40297)
0812 21:02:39.596391 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.596395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.596407 (+ 12us) server_negotiation.cc:407] Connection header received
0812 21:02:39.596460 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.596462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.596480 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.596573 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:39.596807 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.597636 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.599036 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.599756 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.599838 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.599950 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.600111 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.600166 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":118,"threads_started":1}
I20260812 21:02:39.600684 12460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.595541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:40775 (local address 127.0.0.1:45062)
0812 21:02:39.595802 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.595864 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:39.595952 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:39.596681 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:39.596682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:39.596683 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:39.596743 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.596745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.598157 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.598157 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.599344 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.599347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.600384 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.600386 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.600476 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.600482 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:02:39.600530 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 21:02:39.600585 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":3,"thread_start_us":87,"threads_started":1}
I20260812 21:02:39.600594 12461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.595799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35873 (local address 127.0.0.1:50694)
0812 21:02:39.596184 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.596195 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:39.596246 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:39.596668 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:39.596669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:39.596672 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:39.596744 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.596745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.598149 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.598150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.599355 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.599357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.600320 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.600321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.600392 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.600398 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 21:02:39.600469 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 21:02:39.600523 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":23,"thread_start_us":101,"threads_started":1}
I20260812 21:02:39.600984 12469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.596122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50694 (local address 127.10.30.65:35873)
0812 21:02:39.596376 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.596383 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.596396 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:02:39.596459 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.596461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.596480 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.596571 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:39.596838 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.598047 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.599463 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.600130 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.600193 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.600283 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.600639 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.600686 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":149,"threads_started":1}
I20260812 21:02:39.601343 12463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.595677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45062 (local address 127.10.30.67:40775)
0812 21:02:39.596455 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.596460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.596479 (+ 19us) server_negotiation.cc:407] Connection header received
0812 21:02:39.596523 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.596524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.596539 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.596687 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:39.596853 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.598052 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.599442 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.600265 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.601023 (+ 758us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.601153 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.601185 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.601242 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":110,"threads_started":1}
I20260812 21:02:39.601729 11924 tablet_service.cc:1467] Processing CreateTablet for tablet 8b084cf8cc4544939d89cffd4973a9bb (DEFAULT_TABLE table=test-table [id=e60af3a61c0545c5891491ef19871812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:39.601675 12124 tablet_service.cc:1467] Processing CreateTablet for tablet 8b084cf8cc4544939d89cffd4973a9bb (DEFAULT_TABLE table=test-table [id=e60af3a61c0545c5891491ef19871812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:39.602181 11924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b084cf8cc4544939d89cffd4973a9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:39.602180 12124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b084cf8cc4544939d89cffd4973a9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:39.606705 12473 tablet_bootstrap.cc:492] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a: Bootstrap starting.
I20260812 21:02:39.607199 12471 tablet_bootstrap.cc:492] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Bootstrap starting.
I20260812 21:02:39.607455 12337 tablet_service.cc:1467] Processing CreateTablet for tablet 8b084cf8cc4544939d89cffd4973a9bb (DEFAULT_TABLE table=test-table [id=e60af3a61c0545c5891491ef19871812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 21:02:39.607937 12337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b084cf8cc4544939d89cffd4973a9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:39.607940 12473 tablet_bootstrap.cc:654] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:39.608224 12471 tablet_bootstrap.cc:654] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:39.608397 12473 log.cc:824] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:39.608623 12471 log.cc:824] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:39.609485 12471 tablet_bootstrap.cc:492] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: No bootstrap required, opened a new log
I20260812 21:02:39.609562 12471 ts_tablet_manager.cc:1397] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 21:02:39.611867 12473 tablet_bootstrap.cc:492] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a: No bootstrap required, opened a new log
I20260812 21:02:39.611964 12473 ts_tablet_manager.cc:1397] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260812 21:02:39.611891 12477 tablet_bootstrap.cc:492] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Bootstrap starting.
I20260812 21:02:39.612645 12471 raft_consensus.cc:348] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.612852 12471 raft_consensus.cc:374] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:39.612905 12471 raft_consensus.cc:729] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95fd0c4e6a8d428c98b297b7a10fb81d, State: Initialized, Role: FOLLOWER
I20260812 21:02:39.612933 12477 tablet_bootstrap.cc:654] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:39.613095 12471 consensus_queue.cc:260] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.613332 12477 log.cc:824] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:39.613477 12471 ts_tablet_manager.cc:1428] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 21:02:39.614261 12477 tablet_bootstrap.cc:492] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: No bootstrap required, opened a new log
I20260812 21:02:39.614385 12477 ts_tablet_manager.cc:1397] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 21:02:39.614840 12473 raft_consensus.cc:348] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.615054 12473 raft_consensus.cc:374] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:39.615129 12473 raft_consensus.cc:729] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6335d670ae4344950ba3fa492d3d5a, State: Initialized, Role: FOLLOWER
I20260812 21:02:39.615283 12473 consensus_queue.cc:260] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.615638 12473 ts_tablet_manager.cc:1428] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260812 21:02:39.615662 12026 heartbeater.cc:503] Master 127.10.30.126:38199 was elected leader, sending a full tablet report...
I20260812 21:02:39.615787 12233 heartbeater.cc:503] Master 127.10.30.126:38199 was elected leader, sending a full tablet report...
I20260812 21:02:39.617170 12477 raft_consensus.cc:348] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.617354 12477 raft_consensus.cc:374] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:39.617424 12477 raft_consensus.cc:729] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 368162237d0e4155a4996f7200b219b7, State: Initialized, Role: FOLLOWER
I20260812 21:02:39.617542 12477 consensus_queue.cc:260] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.617863 12477 ts_tablet_manager.cc:1428] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 21:02:39.617883 12446 heartbeater.cc:503] Master 127.10.30.126:38199 was elected leader, sending a full tablet report...
W20260812 21:02:39.664096 12237 tablet.cc:2369] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 21:02:39.747726 12027 tablet.cc:2369] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:02:39.812223 12478 raft_consensus.cc:482] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 21:02:39.812444 12478 raft_consensus.cc:504] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.812988 12478 leader_election.cc:288] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 368162237d0e4155a4996f7200b219b7 (127.10.30.67:40775), 5f6335d670ae4344950ba3fa492d3d5a (127.10.30.65:35873)
I20260812 21:02:39.816936 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.813292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.67:40775 (local address 127.10.30.66:39171)
0812 21:02:39.813376 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.813393 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:39.813460 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:39.813765 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:39.813766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:39.813768 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:39.813894 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.813897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.814805 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.814806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.815808 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.815811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.816591 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.816593 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.816682 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.816687 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:02:39.816746 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 21:02:39.816811 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":1}
I20260812 21:02:39.816933 12463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.813470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:39171 (local address 127.10.30.67:40775)
0812 21:02:39.813568 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.813572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.813585 (+ 13us) server_negotiation.cc:407] Connection header received
0812 21:02:39.813633 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.813634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.813646 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.813743 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:39.814008 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.814654 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.815930 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.816490 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.816560 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.816571 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.816772 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.816840 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 21:02:39.817104 12484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.813442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35873 (local address 127.10.30.66:46059)
0812 21:02:39.813739 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.813754 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:02:39.813838 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:02:39.813998 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:02:39.813999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:02:39.814001 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 21:02:39.814098 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.814100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.815055 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.815056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.816035 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:02:39.816039 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.816689 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.816690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:02:39.816801 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.816806 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 21:02:39.816870 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 21:02:39.816915 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":213,"threads_started":1}
I20260812 21:02:39.817122 12469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.813581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.30.66:46059 (local address 127.10.30.65:35873)
0812 21:02:39.813680 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.813683 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.813840 (+ 157us) server_negotiation.cc:407] Connection header received
0812 21:02:39.813890 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.813891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.813907 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.813981 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 21:02:39.814219 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.814830 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.816153 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.816590 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.816683 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.816693 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.816965 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.817028 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 21:02:39.817487 11954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b084cf8cc4544939d89cffd4973a9bb" candidate_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6335d670ae4344950ba3fa492d3d5a" is_pre_election: true
I20260812 21:02:39.817498 12373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b084cf8cc4544939d89cffd4973a9bb" candidate_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "368162237d0e4155a4996f7200b219b7" is_pre_election: true
I20260812 21:02:39.817703 12373 raft_consensus.cc:2454] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95fd0c4e6a8d428c98b297b7a10fb81d in term 0.
I20260812 21:02:39.817703 11954 raft_consensus.cc:2454] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95fd0c4e6a8d428c98b297b7a10fb81d in term 0.
I20260812 21:02:39.818061 12050 leader_election.cc:302] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 368162237d0e4155a4996f7200b219b7, 95fd0c4e6a8d428c98b297b7a10fb81d; no voters:
I20260812 21:02:39.818228 12478 raft_consensus.cc:2781] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 21:02:39.818305 12478 raft_consensus.cc:482] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 21:02:39.818346 12478 raft_consensus.cc:3037] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:39.819442 12478 raft_consensus.cc:504] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.819633 12478 leader_election.cc:288] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [CANDIDATE]: Term 1 election: Requested vote from peers 368162237d0e4155a4996f7200b219b7 (127.10.30.67:40775), 5f6335d670ae4344950ba3fa492d3d5a (127.10.30.65:35873)
I20260812 21:02:39.819885 12373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b084cf8cc4544939d89cffd4973a9bb" candidate_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "368162237d0e4155a4996f7200b219b7"
I20260812 21:02:39.819885 11954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b084cf8cc4544939d89cffd4973a9bb" candidate_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6335d670ae4344950ba3fa492d3d5a"
I20260812 21:02:39.820019 12373 raft_consensus.cc:3037] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:39.820078 11954 raft_consensus.cc:3037] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:39.821305 12373 raft_consensus.cc:2454] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95fd0c4e6a8d428c98b297b7a10fb81d in term 1.
I20260812 21:02:39.821305 11954 raft_consensus.cc:2454] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95fd0c4e6a8d428c98b297b7a10fb81d in term 1.
I20260812 21:02:39.821585 12050 leader_election.cc:302] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 368162237d0e4155a4996f7200b219b7, 95fd0c4e6a8d428c98b297b7a10fb81d; no voters:
I20260812 21:02:39.821720 12478 raft_consensus.cc:2781] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:39.822038 12478 raft_consensus.cc:686] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 1 LEADER]: Becoming Leader. State: Replica: 95fd0c4e6a8d428c98b297b7a10fb81d, State: Running, Role: LEADER
I20260812 21:02:39.822208 12478 consensus_queue.cc:237] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } }
I20260812 21:02:39.823690 11723 catalog_manager.cc:5495] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d reported cstate change: term changed from 0 to 1, leader changed from <none> to 95fd0c4e6a8d428c98b297b7a10fb81d (127.10.30.66). New cstate: current_term: 1 leader_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95fd0c4e6a8d428c98b297b7a10fb81d" member_type: VOTER last_known_addr { host: "127.10.30.66" port: 40297 } health_report { overall_health: HEALTHY } } }
W20260812 21:02:39.823794 12447 tablet.cc:2369] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:02:39.831097 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.828029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51842 (local address 127.10.30.66:40297)
0812 21:02:39.828118 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:39.828125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:39.828135 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:02:39.828180 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:39.828181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:39.828207 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:39.828284 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:02:39.828441 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.828999 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.830017 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:39.830275 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:39.830352 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:39.830536 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:02:39.830703 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:02:39.830786 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:39.830836 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 21:02:39.830865 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 21:02:39.834441 12373 raft_consensus.cc:1261] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 1 FOLLOWER]: Refusing update from remote peer 95fd0c4e6a8d428c98b297b7a10fb81d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:39.834441 11954 raft_consensus.cc:1261] T 8b084cf8cc4544939d89cffd4973a9bb P 5f6335d670ae4344950ba3fa492d3d5a [term 1 FOLLOWER]: Refusing update from remote peer 95fd0c4e6a8d428c98b297b7a10fb81d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:02:39.834939 12478 consensus_queue.cc:1035] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "368162237d0e4155a4996f7200b219b7" member_type: VOTER last_known_addr { host: "127.10.30.67" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:39.835213 12485 consensus_queue.cc:1035] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6335d670ae4344950ba3fa492d3d5a" member_type: VOTER last_known_addr { host: "127.10.30.65" port: 35873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:02:39.838172 12492 mvcc.cc:205] Tried to move back new op lower bound from 7317784821077037056 to 7317784821032796160. Current Snapshot: MvccSnapshot[applied={T|T < 7317784821077037056}]
I20260812 21:02:39.839910 12493 mvcc.cc:205] Tried to move back new op lower bound from 7317784821077037056 to 7317784821032796160. Current Snapshot: MvccSnapshot[applied={T|T < 7317784821077037056}]
I20260812 21:02:39.841778 11723 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:39.841934 11723 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 21:02:39.843457 11723 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9b2c56583c3d41259df4eeed6bc21e9b: Sending DeleteTablet for 3 replicas of tablet 8b084cf8cc4544939d89cffd4973a9bb
I20260812 21:02:39.844024 12124 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b084cf8cc4544939d89cffd4973a9bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:39 UTC) from {username='slave'} at 127.0.0.1:51826
I20260812 21:02:39.844264 12337 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b084cf8cc4544939d89cffd4973a9bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:39 UTC) from {username='slave'} at 127.0.0.1:45062
I20260812 21:02:39.844511 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 11826
I20260812 21:02:39.844646 11924 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b084cf8cc4544939d89cffd4973a9bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 21:02:39 UTC) from {username='slave'} at 127.0.0.1:50694
I20260812 21:02:39.875893 12511 tablet_replica.cc:330] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: stopping tablet replica
I20260812 21:02:39.876223 12511 raft_consensus.cc:2229] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 21:02:39.876431 12511 raft_consensus.cc:2258] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:39.876901 12508 tablet_replica.cc:330] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: stopping tablet replica
I20260812 21:02:39.877080 12508 raft_consensus.cc:2229] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 1 LEADER]: Raft consensus shutting down.
I20260812 21:02:39.877231 12508 raft_consensus.cc:2258] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 21:02:39.877543 12511 ts_tablet_manager.cc:1905] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:39.877839 12508 ts_tablet_manager.cc:1905] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 21:02:39.880512 12508 ts_tablet_manager.cc:1918] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:39.880512 12511 ts_tablet_manager.cc:1918] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 21:02:39.880637 12508 log.cc:1196] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-1/wal/wals/8b084cf8cc4544939d89cffd4973a9bb
I20260812 21:02:39.880842 12511 log.cc:1196] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Deleting WAL directory at /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786568275908695-10361-0/minicluster-data/ts-2/wal/wals/8b084cf8cc4544939d89cffd4973a9bb
I20260812 21:02:39.880962 12508 ts_tablet_manager.cc:1939] T 8b084cf8cc4544939d89cffd4973a9bb P 95fd0c4e6a8d428c98b297b7a10fb81d: Deleting consensus metadata
W20260812 21:02:39.880978 11706 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.30.65:35873 (error 108)
I20260812 21:02:39.881325 12511 ts_tablet_manager.cc:1939] T 8b084cf8cc4544939d89cffd4973a9bb P 368162237d0e4155a4996f7200b219b7: Deleting consensus metadata
I20260812 21:02:39.881565 11705 catalog_manager.cc:4841] TS 95fd0c4e6a8d428c98b297b7a10fb81d (127.10.30.66:40297): tablet 8b084cf8cc4544939d89cffd4973a9bb (table test-table [id=e60af3a61c0545c5891491ef19871812]) successfully deleted
I20260812 21:02:39.881883 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12029
I20260812 21:02:39.882093 11706 catalog_manager.cc:4841] TS 368162237d0e4155a4996f7200b219b7 (127.10.30.67:40775): tablet 8b084cf8cc4544939d89cffd4973a9bb (table test-table [id=e60af3a61c0545c5891491ef19871812]) successfully deleted
I20260812 21:02:39.886107 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:39.882030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.65:35873 (local address 127.0.0.1:50710)
0812 21:02:39.885954 (+ 3924us) negotiation.cc:107] Waiting for socket to connect
0812 21:02:39.886057 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3877}
W20260812 21:02:39.898869 11706 catalog_manager.cc:4584] TS 5f6335d670ae4344950ba3fa492d3d5a (127.10.30.65:35873): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b084cf8cc4544939d89cffd4973a9bb: Network error: Client connection negotiation failed: client connection to 127.10.30.65:35873: connect: Connection refused (error 111)
I20260812 21:02:39.906026 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12239
I20260812 21:02:39.934414 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 11683
2026-08-12T21:02:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1110 ms)
[----------] 6 tests from EncryptionPolicyTest (11351 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:40 dist-test-slave-h3ft krb5kdc[12516](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:40 dist-test-slave-h3ft krb5kdc[12516](info): set up 2 sockets
Aug 12 21:02:40 dist-test-slave-h3ft krb5kdc[12516](info): commencing operation
krb5kdc: starting...
W20260812 21:02:41.325452 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.352s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:41 dist-test-slave-h3ft krb5kdc[12516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:41.496564 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37799
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:41.601059 12536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:41.601550 12536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:41.601605 12536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:41.603262 12536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:41.603382 12536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:41.603413 12536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:41.603442 12536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:41.603474 12536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:41.605512 12536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37799
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:41.605973 12536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:41.606287 12536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:41.612365 12546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:41.612365 12548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:41.612391 12543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:41.613065 12536 server_base.cc:1034] running on GCE node
I20260812 21:02:41.613411 12536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:41.613821 12536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:41.615094 12536 hybrid_clock.cc:648] HybridClock initialized: now 1786568561615059 us; error 48 us; skew 500 ppm
Aug 12 21:02:41 dist-test-slave-h3ft krb5kdc[12516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568561, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:41.618630 12536 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:41.619395 12536 webserver.cc:460] Webserver started at http://127.0.0.1:40673/ using document root <none> and password file <none>
I20260812 21:02:41.619693 12536 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:41.619793 12536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:41.619959 12536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:41.621290 12536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "874d75e0f9724c12822cdc84dfba58e3"
format_stamp: "Formatted at 2026-08-12 21:02:41 on dist-test-slave-h3ft"
server_key: "08970a9124cc51a3270c169ee314154e"
server_key_iv: "bd1bb3adaa8dbc12bb9b41dff1a554f2"
server_key_version: "encryptionkey@0"
I20260812 21:02:41.621832 12536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "874d75e0f9724c12822cdc84dfba58e3"
format_stamp: "Formatted at 2026-08-12 21:02:41 on dist-test-slave-h3ft"
server_key: "08970a9124cc51a3270c169ee314154e"
server_key_iv: "bd1bb3adaa8dbc12bb9b41dff1a554f2"
server_key_version: "encryptionkey@0"
I20260812 21:02:41.623932 12536 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:02:41.625063 12556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:41.625346 12536 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:41.625504 12536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "874d75e0f9724c12822cdc84dfba58e3"
format_stamp: "Formatted at 2026-08-12 21:02:41 on dist-test-slave-h3ft"
server_key: "08970a9124cc51a3270c169ee314154e"
server_key_iv: "bd1bb3adaa8dbc12bb9b41dff1a554f2"
server_key_version: "encryptionkey@0"
I20260812 21:02:41.625602 12536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:41.647588 12536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:41.650611 12536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:41.650790 12536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:41.655975 12536 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37799
I20260812 21:02:41.656105 12649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37799 every 8 connection(s)
I20260812 21:02:41.656527 12536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:41.657775 12651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:41.660801 12651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3: Bootstrap starting.
I20260812 21:02:41.661580 12651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:41.661980 12651 log.cc:824] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:41.662966 12651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3: No bootstrap required, opened a new log
I20260812 21:02:41.664971 12651 raft_consensus.cc:348] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874d75e0f9724c12822cdc84dfba58e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37799 } }
I20260812 21:02:41.665179 12651 raft_consensus.cc:374] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:41.665231 12651 raft_consensus.cc:729] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874d75e0f9724c12822cdc84dfba58e3, State: Initialized, Role: FOLLOWER
I20260812 21:02:41.665447 12651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874d75e0f9724c12822cdc84dfba58e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37799 } }
I20260812 21:02:41.665493 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12536
I20260812 21:02:41.665550 12651 raft_consensus.cc:388] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:41.665606 12651 raft_consensus.cc:482] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:41.665634 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:41.665670 12651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:41.665894 10361 external_mini_cluster.cc:1428] Setting key 22bd20bb0ee67b890d263cb4c93e3f64
I20260812 21:02:41.666683 12651 raft_consensus.cc:504] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874d75e0f9724c12822cdc84dfba58e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37799 } }
I20260812 21:02:41.666822 12651 leader_election.cc:302] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 874d75e0f9724c12822cdc84dfba58e3; no voters:
I20260812 21:02:41.667047 12651 leader_election.cc:288] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:41.667145 12657 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:41.667333 12657 raft_consensus.cc:686] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [term 1 LEADER]: Becoming Leader. State: Replica: 874d75e0f9724c12822cdc84dfba58e3, State: Running, Role: LEADER
I20260812 21:02:41.667379 12651 sys_catalog.cc:564] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:41.667436 12657 consensus_queue.cc:237] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874d75e0f9724c12822cdc84dfba58e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37799 } }
I20260812 21:02:41.668062 12658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "874d75e0f9724c12822cdc84dfba58e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874d75e0f9724c12822cdc84dfba58e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37799 } } }
I20260812 21:02:41.668164 12658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:41.668429 12659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 874d75e0f9724c12822cdc84dfba58e3. Latest consensus state: current_term: 1 leader_uuid: "874d75e0f9724c12822cdc84dfba58e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874d75e0f9724c12822cdc84dfba58e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37799 } } }
I20260812 21:02:41.668542 12659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:41.668690 12673 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:41.669427 12673 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:41.671649 12673 catalog_manager.cc:1347] Generated new cluster ID: 231da680647b438d86c6855ccb4ffe96
I20260812 21:02:41.671720 12673 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 21:02:41 dist-test-slave-h3ft krb5kdc[12516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 21:02:41.678954 12673 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:41.679970 12673 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:41.680217 12655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:41.666680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44857 (local address 127.0.0.1:37799)
0812 21:02:41.666981 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:41.666993 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:41.667062 (+ 69us) server_negotiation.cc:407] Connection header received
0812 21:02:41.667222 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:41.667231 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:41.667301 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:41.668532 (+ 1231us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:41.668682 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:41.670243 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:41.671397 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:41.672054 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:41.672166 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:41.675607 (+ 3441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:41.675614 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:41.675615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:41.675630 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:41.677951 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:41.678522 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:41.678527 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:41.678527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:41.678684 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:41.679024 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:41.679026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:41.679026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:41.679360 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:41.679584 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:41.679730 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 21:02:41.679854 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":129,"threads_started":1}
I20260812 21:02:41.681453 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:41.684801 12673 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 874d75e0f9724c12822cdc84dfba58e3: Generated new TSK 0
I20260812 21:02:41.685122 12673 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:41.691478 12655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:41.683243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33691 (local address 127.0.0.1:37799)
0812 21:02:41.683370 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:41.683372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:41.683439 (+ 67us) server_negotiation.cc:407] Connection header received
0812 21:02:41.683533 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:41.683534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:41.683545 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:41.683593 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:41.684196 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:41.684962 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:41.685817 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:41.686190 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:41.686276 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:41.687895 (+ 1619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:41.687900 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:41.687901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:41.687914 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:41.689849 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:41.690375 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:41.690377 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:41.690377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:41.690455 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:41.690753 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:41.690754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:41.690754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:41.690921 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:41.691117 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:41.691275 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 21:02:41.691356 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 21:02:41.694185 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12536
W20260812 21:02:41.723305 12514 connection.cc:535] client connection to 127.0.0.1:37799 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37799): Connection reset by peer (error 104)
2026-08-12T21:02:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1764 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:41 dist-test-slave-h3ft krb5kdc[12699](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:41 dist-test-slave-h3ft krb5kdc[12699](info): set up 2 sockets
Aug 12 21:02:41 dist-test-slave-h3ft krb5kdc[12699](info): commencing operation
krb5kdc: starting...
W20260812 21:02:43.113586 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.375s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:43 dist-test-slave-h3ft krb5kdc[12699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:43.280090 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:43.374745 12722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:43.375087 12722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:43.375128 12722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:43.376339 12722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:43.376416 12722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:43.376442 12722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:43.376466 12722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:43.376495 12722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:43.378078 12722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41737
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:43.378389 12722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:43.378654 12722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:43.384898 12731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:43.384872 12722 server_base.cc:1034] running on GCE node
W20260812 21:02:43.384896 12729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:43.384872 12728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:43.385617 12722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:43.385949 12722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:43.387179 12722 hybrid_clock.cc:648] HybridClock initialized: now 1786568563387144 us; error 51 us; skew 500 ppm
Aug 12 21:02:43 dist-test-slave-h3ft krb5kdc[12699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568563, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:43.390197 12722 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:43.390769 12722 webserver.cc:460] Webserver started at http://127.0.0.1:33445/ using document root <none> and password file <none>
I20260812 21:02:43.391103 12722 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:43.391211 12722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:43.391386 12722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:43.392604 12722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "8fd7566c22b24f3d95404807389cd9c7"
format_stamp: "Formatted at 2026-08-12 21:02:43 on dist-test-slave-h3ft"
server_key: "42225c62956d611d66ac14c4b02bb447"
server_key_iv: "b6ca2ffe0a5e169a0ec21a19aff8e5b6"
server_key_version: "encryptionkey@0"
I20260812 21:02:43.393024 12722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "8fd7566c22b24f3d95404807389cd9c7"
format_stamp: "Formatted at 2026-08-12 21:02:43 on dist-test-slave-h3ft"
server_key: "42225c62956d611d66ac14c4b02bb447"
server_key_iv: "b6ca2ffe0a5e169a0ec21a19aff8e5b6"
server_key_version: "encryptionkey@0"
I20260812 21:02:43.394778 12722 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 21:02:43.396054 12743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:43.396391 12722 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:43.396521 12722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "8fd7566c22b24f3d95404807389cd9c7"
format_stamp: "Formatted at 2026-08-12 21:02:43 on dist-test-slave-h3ft"
server_key: "42225c62956d611d66ac14c4b02bb447"
server_key_iv: "b6ca2ffe0a5e169a0ec21a19aff8e5b6"
server_key_version: "encryptionkey@0"
I20260812 21:02:43.396615 12722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:43.404989 12722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:43.407581 12722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:43.407775 12722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:43.413179 12722 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41737
I20260812 21:02:43.413367 12828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41737 every 8 connection(s)
I20260812 21:02:43.413694 12722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:43.414942 12829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:43.418251 12829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7: Bootstrap starting.
I20260812 21:02:43.418447 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12722
I20260812 21:02:43.418602 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:43.418911 10361 external_mini_cluster.cc:1428] Setting key 68087648bf474b374c863eee9a019e6d
I20260812 21:02:43.419358 12829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:43.419843 12829 log.cc:824] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:43.420943 12829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7: No bootstrap required, opened a new log
I20260812 21:02:43.424114 12829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd7566c22b24f3d95404807389cd9c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41737 } }
I20260812 21:02:43.424367 12829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:43.424471 12829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fd7566c22b24f3d95404807389cd9c7, State: Initialized, Role: FOLLOWER
I20260812 21:02:43.424661 12829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd7566c22b24f3d95404807389cd9c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41737 } }
I20260812 21:02:43.424765 12829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:43.424818 12829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:43.424878 12829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:43.425879 12829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd7566c22b24f3d95404807389cd9c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41737 } }
I20260812 21:02:43.426045 12829 leader_election.cc:302] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fd7566c22b24f3d95404807389cd9c7; no voters:
I20260812 21:02:43.426309 12829 leader_election.cc:288] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:43.426340 12836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:43.426501 12836 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [term 1 LEADER]: Becoming Leader. State: Replica: 8fd7566c22b24f3d95404807389cd9c7, State: Running, Role: LEADER
I20260812 21:02:43.426608 12836 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd7566c22b24f3d95404807389cd9c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41737 } }
I20260812 21:02:43.426707 12829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:43.427131 12833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:43.419739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34141 (local address 127.0.0.1:41737)
0812 21:02:43.419997 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:43.420010 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:43.420059 (+ 49us) server_negotiation.cc:407] Connection header received
0812 21:02:43.420975 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:43.420984 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:43.421045 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:43.421251 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:43.421611 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:43.422664 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:43.424153 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:43.424890 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:43.425026 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:43.426116 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:43.426120 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:43.426121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:43.426345 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:43.426415 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:43.426433 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:43.426539 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:43.426829 (+ 290us) server_negotiation.cc:299] Negotiation successful
0812 21:02:43.426865 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":109,"threads_started":1}
I20260812 21:02:43.427151 12837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fd7566c22b24f3d95404807389cd9c7. Latest consensus state: current_term: 1 leader_uuid: "8fd7566c22b24f3d95404807389cd9c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd7566c22b24f3d95404807389cd9c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41737 } } }
I20260812 21:02:43.427464 12837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:43.427171 12838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fd7566c22b24f3d95404807389cd9c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd7566c22b24f3d95404807389cd9c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41737 } } }
I20260812 21:02:43.427958 12838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:43.429028 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:43.428964 12849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:43.431178 12849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:43.433615 12849 catalog_manager.cc:1347] Generated new cluster ID: 57aceb0cb0cd4520be130dbf27aa0e6a
I20260812 21:02:43.433679 12849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:43.435580 12833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:43.431384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49939 (local address 127.0.0.1:41737)
0812 21:02:43.431462 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:43.431465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:43.431764 (+ 299us) server_negotiation.cc:407] Connection header received
0812 21:02:43.431807 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:43.431808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:43.431822 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:43.431904 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:43.432108 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:43.432725 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:43.433862 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:43.434219 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:43.434307 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:43.435248 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:43.435249 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:43.435250 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:43.435256 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:43.435276 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:43.435281 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:43.435349 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:43.435473 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 21:02:43.435488 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 21:02:43.441951 12849 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:43.442790 12849 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:43.454200 12849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fd7566c22b24f3d95404807389cd9c7: Generated new TSK 0
I20260812 21:02:43.454468 12849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:43.457564 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12722
W20260812 21:02:43.481010 12695 connection.cc:535] client connection to 127.0.0.1:41737 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41737): Connection reset by peer (error 104)
2026-08-12T21:02:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1758 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:43 dist-test-slave-h3ft krb5kdc[12876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:43 dist-test-slave-h3ft krb5kdc[12876](info): set up 2 sockets
Aug 12 21:02:43 dist-test-slave-h3ft krb5kdc[12876](info): commencing operation
krb5kdc: starting...
W20260812 21:02:44.874266 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.378s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:44 dist-test-slave-h3ft krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:45.032781 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37661
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:45.138300 12899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:45.138684 12899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:45.138733 12899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:45.140332 12899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:45.140434 12899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:45.140460 12899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:45.140483 12899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:45.140514 12899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:45.142387 12899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37661
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:45.142762 12899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:45.143091 12899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:45.149324 12915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:45.149495 12899 server_base.cc:1034] running on GCE node
W20260812 21:02:45.149610 12911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:45.149324 12908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:45.150048 12899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:45.150501 12899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:45.151662 12899 hybrid_clock.cc:648] HybridClock initialized: now 1786568565151643 us; error 49 us; skew 500 ppm
Aug 12 21:02:45 dist-test-slave-h3ft krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568565, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:45.159667 12899 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:45.160326 12899 webserver.cc:460] Webserver started at http://127.0.0.1:37811/ using document root <none> and password file <none>
I20260812 21:02:45.160571 12899 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:45.160619 12899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:45.160735 12899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:45.162099 12899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c"
format_stamp: "Formatted at 2026-08-12 21:02:45 on dist-test-slave-h3ft"
server_key: "6ac0efdcd96e1881bf5b18aee5ea7646"
server_key_iv: "0018139caaad421bb2d844a777c38bb6"
server_key_version: "encryptionkey@0"
I20260812 21:02:45.162484 12899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c"
format_stamp: "Formatted at 2026-08-12 21:02:45 on dist-test-slave-h3ft"
server_key: "6ac0efdcd96e1881bf5b18aee5ea7646"
server_key_iv: "0018139caaad421bb2d844a777c38bb6"
server_key_version: "encryptionkey@0"
I20260812 21:02:45.164311 12899 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 21:02:45.165336 12927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:45.165670 12899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:45.165810 12899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c"
format_stamp: "Formatted at 2026-08-12 21:02:45 on dist-test-slave-h3ft"
server_key: "6ac0efdcd96e1881bf5b18aee5ea7646"
server_key_iv: "0018139caaad421bb2d844a777c38bb6"
server_key_version: "encryptionkey@0"
I20260812 21:02:45.165910 12899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:45.170033 12899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:45.172955 12899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:45.173156 12899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:45.178589 12899 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37661
I20260812 21:02:45.178655 13007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37661 every 8 connection(s)
I20260812 21:02:45.179206 12899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:45.180672 13008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:45.181375 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 12899
I20260812 21:02:45.181558 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:45.181802 10361 external_mini_cluster.cc:1428] Setting key 40eac5f6f34432ab95713284cfc05c6c
I20260812 21:02:45.184760 13008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c: Bootstrap starting.
I20260812 21:02:45.185325 13017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:45.182555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37125 (local address 127.0.0.1:37661)
0812 21:02:45.182816 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:45.182829 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:45.182869 (+ 40us) server_negotiation.cc:407] Connection header received
0812 21:02:45.183672 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:45.183684 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:45.183728 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:45.183917 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:45.184730 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:45.184735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:45.184735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:45.184740 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:45.184799 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:45.184815 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:45.184899 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:45.185004 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 21:02:45.185052 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":107,"threads_started":1}
I20260812 21:02:45.185767 13008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:45.186311 13008 log.cc:824] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:45.186959 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:45.187343 13008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c: No bootstrap required, opened a new log
I20260812 21:02:45.189845 13008 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } }
I20260812 21:02:45.190122 13008 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:45.190205 13008 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82ad9614ab0b4ba2bdcbd1eb8af2348c, State: Initialized, Role: FOLLOWER
I20260812 21:02:45.190301 13017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:45.188892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39211 (local address 127.0.0.1:37661)
0812 21:02:45.188948 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:45.188951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:45.189065 (+ 114us) server_negotiation.cc:407] Connection header received
0812 21:02:45.189112 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:45.189113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:45.189121 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:45.189211 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:45.189935 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:45.189937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:45.189937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:45.189942 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:45.189962 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:45.189968 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:45.190044 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:45.190198 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 21:02:45.190218 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 21:02:45.190367 13008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } }
I20260812 21:02:45.190492 13008 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:45.190546 13008 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:45.190609 13008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:45.191670 13008 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } }
I20260812 21:02:45.191799 13008 leader_election.cc:302] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82ad9614ab0b4ba2bdcbd1eb8af2348c; no voters:
I20260812 21:02:45.192088 13008 leader_election.cc:288] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:45.192286 13027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:45.192533 13008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:45.192543 13027 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [term 1 LEADER]: Becoming Leader. State: Replica: 82ad9614ab0b4ba2bdcbd1eb8af2348c, State: Running, Role: LEADER
I20260812 21:02:45.192744 13027 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } }
I20260812 21:02:45.193245 13028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } } }
I20260812 21:02:45.193244 13031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82ad9614ab0b4ba2bdcbd1eb8af2348c. Latest consensus state: current_term: 1 leader_uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ad9614ab0b4ba2bdcbd1eb8af2348c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } } }
I20260812 21:02:45.193403 13028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:45.193405 13031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:45.193675 13040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:45.194375 13040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:45.196463 13040 catalog_manager.cc:1347] Generated new cluster ID: 4dfb35bbb53640ac97d43787b3431a27
I20260812 21:02:45.196556 13040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:45.218861 13040 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:45.219173 13040 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:45.223263 13040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82ad9614ab0b4ba2bdcbd1eb8af2348c: Generated new TSK 0
I20260812 21:02:45.223532 13040 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:45.225795 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 12899
2026-08-12T21:02:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1763 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:45 dist-test-slave-h3ft krb5kdc[13058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:45 dist-test-slave-h3ft krb5kdc[13058](info): set up 2 sockets
Aug 12 21:02:45 dist-test-slave-h3ft krb5kdc[13058](info): commencing operation
krb5kdc: starting...
W20260812 21:02:46.596777 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:46 dist-test-slave-h3ft krb5kdc[13058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:46.760365 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42671
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:46.872810 13081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:46.873131 13081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:46.873163 13081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:46.874652 13081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:46.874714 13081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:46.874729 13081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:46.874742 13081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:46.874755 13081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:46.876662 13081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:46.877007 13081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:46.877307 13081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 21:02:46.883349 13081 server_base.cc:1034] running on GCE node
W20260812 21:02:46.883322 13098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:46.883329 13089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:46.883445 13093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:46.884064 13081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:46.884442 13081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:46.885676 13081 hybrid_clock.cc:648] HybridClock initialized: now 1786568566885634 us; error 65 us; skew 500 ppm
Aug 12 21:02:46 dist-test-slave-h3ft krb5kdc[13058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568566, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:46.889170 13081 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:46.889720 13081 webserver.cc:460] Webserver started at http://127.0.0.1:33313/ using document root <none> and password file <none>
I20260812 21:02:46.889972 13081 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:46.890031 13081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:46.890151 13081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:46.891566 13081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "e2bfcefbd68a4e4892906b54fb28060f"
format_stamp: "Formatted at 2026-08-12 21:02:46 on dist-test-slave-h3ft"
server_key: "f44fa26961468d5abf1e53c7a0a3beb3"
server_key_iv: "b4845c6687bac711592df27ec65005dc"
server_key_version: "encryptionkey@0"
I20260812 21:02:46.891969 13081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "e2bfcefbd68a4e4892906b54fb28060f"
format_stamp: "Formatted at 2026-08-12 21:02:46 on dist-test-slave-h3ft"
server_key: "f44fa26961468d5abf1e53c7a0a3beb3"
server_key_iv: "b4845c6687bac711592df27ec65005dc"
server_key_version: "encryptionkey@0"
I20260812 21:02:46.893610 13081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 21:02:46.894670 13115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:46.894908 13081 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:46.895066 13081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "e2bfcefbd68a4e4892906b54fb28060f"
format_stamp: "Formatted at 2026-08-12 21:02:46 on dist-test-slave-h3ft"
server_key: "f44fa26961468d5abf1e53c7a0a3beb3"
server_key_iv: "b4845c6687bac711592df27ec65005dc"
server_key_version: "encryptionkey@0"
I20260812 21:02:46.895180 13081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:46.914765 13081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:46.917920 13081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:46.918182 13081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:46.923888 13081 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42671
I20260812 21:02:46.923972 13192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42671 every 8 connection(s)
I20260812 21:02:46.924494 13081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:46.925694 13194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:46.928745 13194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f: Bootstrap starting.
I20260812 21:02:46.929103 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13081
I20260812 21:02:46.929243 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:46.929502 10361 external_mini_cluster.cc:1428] Setting key de6588434b6ca770953479ed8a899499
I20260812 21:02:46.929672 13194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:46.930054 13194 log.cc:824] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:46.931067 13194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f: No bootstrap required, opened a new log
I20260812 21:02:46.933812 13194 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2bfcefbd68a4e4892906b54fb28060f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42671 } }
I20260812 21:02:46.934042 13194 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:46.934093 13194 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2bfcefbd68a4e4892906b54fb28060f, State: Initialized, Role: FOLLOWER
I20260812 21:02:46.934279 13194 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2bfcefbd68a4e4892906b54fb28060f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42671 } }
I20260812 21:02:46.934373 13194 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:46.934401 13194 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:46.934477 13194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:46.935420 13194 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2bfcefbd68a4e4892906b54fb28060f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42671 } }
I20260812 21:02:46.935554 13194 leader_election.cc:302] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2bfcefbd68a4e4892906b54fb28060f; no voters:
I20260812 21:02:46.935811 13194 leader_election.cc:288] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:46.935906 13202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:46.936158 13202 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [term 1 LEADER]: Becoming Leader. State: Replica: e2bfcefbd68a4e4892906b54fb28060f, State: Running, Role: LEADER
I20260812 21:02:46.936304 13202 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2bfcefbd68a4e4892906b54fb28060f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42671 } }
I20260812 21:02:46.936764 13203 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2bfcefbd68a4e4892906b54fb28060f. Latest consensus state: current_term: 1 leader_uuid: "e2bfcefbd68a4e4892906b54fb28060f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2bfcefbd68a4e4892906b54fb28060f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42671 } } }
I20260812 21:02:46.936933 13203 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:46.936967 13194 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:46.936774 13204 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2bfcefbd68a4e4892906b54fb28060f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2bfcefbd68a4e4892906b54fb28060f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42671 } } }
I20260812 21:02:46.937290 13204 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:46.937701 13210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:46.938588 13210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 21:02:46 dist-test-slave-h3ft krb5kdc[13058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 21:02:46.940977 13210 catalog_manager.cc:1347] Generated new cluster ID: a172398f0fca45e09ede848319f08707
I20260812 21:02:46.941042 13210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:46.945191 13201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:46.930222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53313 (local address 127.0.0.1:42671)
0812 21:02:46.930471 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:46.930483 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:46.930536 (+ 53us) server_negotiation.cc:407] Connection header received
0812 21:02:46.931344 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:46.931355 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:46.931426 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:46.931622 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:46.932417 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:46.934007 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:46.935052 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:46.935772 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:46.935897 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:46.940063 (+ 4166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:46.940068 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:46.940068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:46.940082 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:46.942549 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:46.943150 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:46.943155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:46.943155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:46.943291 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:46.943533 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:46.943534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:46.943534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:46.943905 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:46.944121 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:46.944713 (+ 592us) server_negotiation.cc:299] Negotiation successful
0812 21:02:46.944894 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":155,"threads_started":1}
I20260812 21:02:46.946497 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:46.947072 13210 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:46.947971 13210 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:46.960758 13201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:46.951568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58349 (local address 127.0.0.1:42671)
0812 21:02:46.951633 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:46.951636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:46.951772 (+ 136us) server_negotiation.cc:407] Connection header received
0812 21:02:46.951860 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:46.951861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:46.951875 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:46.951936 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:46.952882 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:46.953709 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:46.955170 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:46.955525 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:46.955602 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:46.957444 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:46.957446 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:46.957447 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:46.957456 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:46.959271 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:46.959737 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:46.959739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:46.959739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:46.959805 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:46.960057 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:46.960058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:46.960058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:46.960207 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:46.960321 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:46.960499 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 21:02:46.960598 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 21:02:46.961514 13210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2bfcefbd68a4e4892906b54fb28060f: Generated new TSK 0
I20260812 21:02:46.961810 13210 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:46.965521 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13081
2026-08-12T21:02:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1742 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:47 dist-test-slave-h3ft krb5kdc[13251](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:47 dist-test-slave-h3ft krb5kdc[13251](info): set up 2 sockets
Aug 12 21:02:47 dist-test-slave-h3ft krb5kdc[13251](info): commencing operation
krb5kdc: starting...
W20260812 21:02:48.357753 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.355s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:48 dist-test-slave-h3ft krb5kdc[13251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:48.515357 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35143
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:48.616585 13277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:48.616953 13277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:48.617002 13277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:48.618355 13277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:48.618460 13277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:48.618489 13277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:48.618517 13277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:48.618552 13277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:48.620437 13277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:48.620823 13277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:48.621138 13277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:48.627410 13288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:48.627410 13297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:48.627429 13291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:48.627774 13277 server_base.cc:1034] running on GCE node
I20260812 21:02:48.628115 13277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:48.628516 13277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:48.629716 13277 hybrid_clock.cc:648] HybridClock initialized: now 1786568568629694 us; error 43 us; skew 500 ppm
Aug 12 21:02:48 dist-test-slave-h3ft krb5kdc[13251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568568, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:48.633608 13277 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:48.634481 13277 webserver.cc:460] Webserver started at http://127.0.0.1:34379/ using document root <none> and password file <none>
I20260812 21:02:48.634795 13277 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:48.634879 13277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:48.635123 13277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:48.636497 13277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "402990ea561d460aa7fc2eb53fabc6bf"
format_stamp: "Formatted at 2026-08-12 21:02:48 on dist-test-slave-h3ft"
server_key: "ae69e8dacd8bcfba441516aeac8ad6e2"
server_key_iv: "e68404cabb0ca88d632b513b3c98b22f"
server_key_version: "encryptionkey@0"
I20260812 21:02:48.636962 13277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "402990ea561d460aa7fc2eb53fabc6bf"
format_stamp: "Formatted at 2026-08-12 21:02:48 on dist-test-slave-h3ft"
server_key: "ae69e8dacd8bcfba441516aeac8ad6e2"
server_key_iv: "e68404cabb0ca88d632b513b3c98b22f"
server_key_version: "encryptionkey@0"
I20260812 21:02:48.638734 13277 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 21:02:48.640256 13311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:48.640550 13277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:02:48.640708 13277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "402990ea561d460aa7fc2eb53fabc6bf"
format_stamp: "Formatted at 2026-08-12 21:02:48 on dist-test-slave-h3ft"
server_key: "ae69e8dacd8bcfba441516aeac8ad6e2"
server_key_iv: "e68404cabb0ca88d632b513b3c98b22f"
server_key_version: "encryptionkey@0"
I20260812 21:02:48.640880 13277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:48.659710 13277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:48.662510 13277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:48.662732 13277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:48.668404 13277 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35143
I20260812 21:02:48.668443 13394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35143 every 8 connection(s)
I20260812 21:02:48.668934 13277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:48.670077 13396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:48.673045 13396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf: Bootstrap starting.
I20260812 21:02:48.673852 13396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:48.674292 13396 log.cc:824] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:48.674340 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13277
I20260812 21:02:48.674471 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:48.674721 10361 external_mini_cluster.cc:1428] Setting key 8443c2f0e7a1e5906e3f3c8486a0fcc8
I20260812 21:02:48.675400 13396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf: No bootstrap required, opened a new log
I20260812 21:02:48.677802 13396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "402990ea561d460aa7fc2eb53fabc6bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35143 } }
I20260812 21:02:48.677995 13396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:48.678030 13396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402990ea561d460aa7fc2eb53fabc6bf, State: Initialized, Role: FOLLOWER
I20260812 21:02:48.678264 13396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "402990ea561d460aa7fc2eb53fabc6bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35143 } }
I20260812 21:02:48.678382 13396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:48.678452 13396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:48.678517 13396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:48.679419 13396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "402990ea561d460aa7fc2eb53fabc6bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35143 } }
I20260812 21:02:48.679565 13396 leader_election.cc:302] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 402990ea561d460aa7fc2eb53fabc6bf; no voters:
I20260812 21:02:48.679781 13396 leader_election.cc:288] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:48.679843 13401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:48.680060 13401 raft_consensus.cc:686] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [term 1 LEADER]: Becoming Leader. State: Replica: 402990ea561d460aa7fc2eb53fabc6bf, State: Running, Role: LEADER
I20260812 21:02:48.680123 13396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:48.680164 13401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "402990ea561d460aa7fc2eb53fabc6bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35143 } }
I20260812 21:02:48.680624 13401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 402990ea561d460aa7fc2eb53fabc6bf. Latest consensus state: current_term: 1 leader_uuid: "402990ea561d460aa7fc2eb53fabc6bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "402990ea561d460aa7fc2eb53fabc6bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35143 } } }
I20260812 21:02:48.680753 13401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:48.681035 13418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:48.681668 13418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:48.682675 13402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "402990ea561d460aa7fc2eb53fabc6bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "402990ea561d460aa7fc2eb53fabc6bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35143 } } }
I20260812 21:02:48.682842 13402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:48.683699 13418 catalog_manager.cc:1347] Generated new cluster ID: 743b57811c62475cbf791e35783c2a28
I20260812 21:02:48.683758 13418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:48.684635 13400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:48.675424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45217 (local address 127.0.0.1:35143)
0812 21:02:48.675659 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:48.675670 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:48.675708 (+ 38us) server_negotiation.cc:407] Connection header received
0812 21:02:48.677806 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:48.677818 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:48.677910 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:48.678150 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:48.678463 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:48.680196 (+ 1733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:48.681593 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:48.682318 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:48.682429 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:48.683628 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:48.683633 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:48.683633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:48.683951 (+ 318us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:48.684002 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:48.684022 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:48.684112 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:48.684251 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 21:02:48.684341 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":115,"threads_started":1}
I20260812 21:02:48.685894 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:48.691913 13400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:48.687861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33721 (local address 127.0.0.1:35143)
0812 21:02:48.687926 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:48.687928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:48.687981 (+ 53us) server_negotiation.cc:407] Connection header received
0812 21:02:48.688054 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:48.688055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:48.688069 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:48.688139 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:48.688308 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:48.689158 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:48.690253 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:48.690573 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:48.690660 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:48.691593 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:48.691595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:48.691596 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:48.691604 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:48.691627 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:48.691633 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:48.691698 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:48.691757 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 21:02:48.691792 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":20}
I20260812 21:02:48.704641 13418 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:48.705586 13418 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:48.711987 13418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 402990ea561d460aa7fc2eb53fabc6bf: Generated new TSK 0
I20260812 21:02:48.712277 13418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:48.723315 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13277
2026-08-12T21:02:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1763 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:48 dist-test-slave-h3ft krb5kdc[13446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:48 dist-test-slave-h3ft krb5kdc[13446](info): set up 2 sockets
Aug 12 21:02:48 dist-test-slave-h3ft krb5kdc[13446](info): commencing operation
krb5kdc: starting...
W20260812 21:02:50.123775 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.358s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:50 dist-test-slave-h3ft krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:50.286870 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39405
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:50.385368 13466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:50.385692 13466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:50.385740 13466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:50.387125 13466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:50.387204 13466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:50.387229 13466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:50.387252 13466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:50.387280 13466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:50.389012 13466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:50.389362 13466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:50.389644 13466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:50.395478 13481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:50.395524 13474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:50.395527 13473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:50.395565 13466 server_base.cc:1034] running on GCE node
I20260812 21:02:50.396163 13466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:50.396548 13466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:50.397753 13466 hybrid_clock.cc:648] HybridClock initialized: now 1786568570397707 us; error 84 us; skew 500 ppm
Aug 12 21:02:50 dist-test-slave-h3ft krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568570, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:50.407558 13466 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:50.408290 13466 webserver.cc:460] Webserver started at http://127.0.0.1:38081/ using document root <none> and password file <none>
I20260812 21:02:50.408632 13466 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:50.408715 13466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:50.408892 13466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:50.410221 13466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "929ff2cf95924dada7d6e5447577f4d6"
format_stamp: "Formatted at 2026-08-12 21:02:50 on dist-test-slave-h3ft"
server_key: "aa054aa152f8732ca0114da59471c708"
server_key_iv: "1f41bb0274524c768e1773fc1a019c38"
server_key_version: "encryptionkey@0"
I20260812 21:02:50.410673 13466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "929ff2cf95924dada7d6e5447577f4d6"
format_stamp: "Formatted at 2026-08-12 21:02:50 on dist-test-slave-h3ft"
server_key: "aa054aa152f8732ca0114da59471c708"
server_key_iv: "1f41bb0274524c768e1773fc1a019c38"
server_key_version: "encryptionkey@0"
I20260812 21:02:50.412436 13466 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:02:50.413450 13492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:50.413687 13466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:50.413818 13466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "929ff2cf95924dada7d6e5447577f4d6"
format_stamp: "Formatted at 2026-08-12 21:02:50 on dist-test-slave-h3ft"
server_key: "aa054aa152f8732ca0114da59471c708"
server_key_iv: "1f41bb0274524c768e1773fc1a019c38"
server_key_version: "encryptionkey@0"
I20260812 21:02:50.413911 13466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:50.417969 13466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:50.420679 13466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:50.420883 13466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:50.426529 13466 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39405
I20260812 21:02:50.426582 13576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39405 every 8 connection(s)
I20260812 21:02:50.427047 13466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:50.428349 13577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:50.431321 13577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6: Bootstrap starting.
I20260812 21:02:50.432102 13577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:50.432446 13577 log.cc:824] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:50.433382 13577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6: No bootstrap required, opened a new log
I20260812 21:02:50.435243 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13466
I20260812 21:02:50.435384 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:50.435617 10361 external_mini_cluster.cc:1428] Setting key 802f608b78d259068a3b678fbe5bed22
I20260812 21:02:50.435617 13577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "929ff2cf95924dada7d6e5447577f4d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260812 21:02:50.435865 13577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:50.435914 13577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929ff2cf95924dada7d6e5447577f4d6, State: Initialized, Role: FOLLOWER
I20260812 21:02:50.436271 13577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "929ff2cf95924dada7d6e5447577f4d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260812 21:02:50.436427 13577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:50.436635 13577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:50.436813 13577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:50.438656 13577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "929ff2cf95924dada7d6e5447577f4d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260812 21:02:50.438858 13582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:50.436486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57417 (local address 127.0.0.1:39405)
0812 21:02:50.436785 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:50.436797 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:50.436936 (+ 139us) server_negotiation.cc:407] Connection header received
0812 21:02:50.437101 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:50.437109 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:50.437140 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:50.437288 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:50.438183 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:50.438187 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:50.438188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:50.438192 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:50.438250 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:50.438264 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:50.438336 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:50.438461 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 21:02:50.438549 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":158,"threads_started":1}
I20260812 21:02:50.438828 13577 leader_election.cc:302] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 929ff2cf95924dada7d6e5447577f4d6; no voters:
I20260812 21:02:50.439169 13577 leader_election.cc:288] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:50.439224 13583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:50.439460 13583 raft_consensus.cc:686] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [term 1 LEADER]: Becoming Leader. State: Replica: 929ff2cf95924dada7d6e5447577f4d6, State: Running, Role: LEADER
I20260812 21:02:50.439535 13577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:50.439581 13583 consensus_queue.cc:237] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "929ff2cf95924dada7d6e5447577f4d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260812 21:02:50.439997 13585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "929ff2cf95924dada7d6e5447577f4d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "929ff2cf95924dada7d6e5447577f4d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } } }
I20260812 21:02:50.440145 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:50.440192 13585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:50.440021 13583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 929ff2cf95924dada7d6e5447577f4d6. Latest consensus state: current_term: 1 leader_uuid: "929ff2cf95924dada7d6e5447577f4d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "929ff2cf95924dada7d6e5447577f4d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } } }
I20260812 21:02:50.440374 13583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:50.441350 13598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:50.442023 13598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:50.443677 13582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:50.442229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54509 (local address 127.0.0.1:39405)
0812 21:02:50.442277 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:50.442279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:50.442410 (+ 131us) server_negotiation.cc:407] Connection header received
0812 21:02:50.442496 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:50.442497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:50.442505 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:50.442558 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:50.443326 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:50.443327 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:50.443328 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:50.443333 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:50.443356 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:50.443361 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:50.443417 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:50.443544 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 21:02:50.443563 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 21:02:50.444119 13598 catalog_manager.cc:1347] Generated new cluster ID: e9e7bf9717494ff2b1008ac32c6b7d17
I20260812 21:02:50.444172 13598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:50.468698 13598 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:50.468984 13598 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:50.472884 13598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 929ff2cf95924dada7d6e5447577f4d6: Generated new TSK 0
I20260812 21:02:50.473179 13598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:50.475863 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13466
2026-08-12T21:02:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1753 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:50 dist-test-slave-h3ft krb5kdc[13623](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:50 dist-test-slave-h3ft krb5kdc[13623](info): set up 2 sockets
Aug 12 21:02:50 dist-test-slave-h3ft krb5kdc[13623](info): commencing operation
krb5kdc: starting...
W20260812 21:02:51.867714 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.348s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:51 dist-test-slave-h3ft krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:52.035701 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43143
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:52.141414 13644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:52.141798 13644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:52.141861 13644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:52.143489 13644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:52.143572 13644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:52.143602 13644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:52.143633 13644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:52.143668 13644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:52.145787 13644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:52.146204 13644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:52.146517 13644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:52.152531 13655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:52.152590 13654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:52.152752 13644 server_base.cc:1034] running on GCE node
W20260812 21:02:52.152554 13658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:52.153103 13644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:52.153522 13644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:52.154711 13644 hybrid_clock.cc:648] HybridClock initialized: now 1786568572154706 us; error 42 us; skew 500 ppm
Aug 12 21:02:52 dist-test-slave-h3ft krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568572, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:52.158164 13644 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:52.158763 13644 webserver.cc:460] Webserver started at http://127.0.0.1:38625/ using document root <none> and password file <none>
I20260812 21:02:52.159143 13644 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:52.159225 13644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:52.159406 13644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:52.160756 13644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "adbe2b3e9d404fb1825a3257ece97d55"
format_stamp: "Formatted at 2026-08-12 21:02:52 on dist-test-slave-h3ft"
server_key: "09df466e35530dea546f185322419680"
server_key_iv: "2b584933c592aaf4a2af9a375d0d27e2"
server_key_version: "encryptionkey@0"
I20260812 21:02:52.161237 13644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "adbe2b3e9d404fb1825a3257ece97d55"
format_stamp: "Formatted at 2026-08-12 21:02:52 on dist-test-slave-h3ft"
server_key: "09df466e35530dea546f185322419680"
server_key_iv: "2b584933c592aaf4a2af9a375d0d27e2"
server_key_version: "encryptionkey@0"
I20260812 21:02:52.163163 13644 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 21:02:52.164354 13666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:52.164687 13644 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:52.164830 13644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "adbe2b3e9d404fb1825a3257ece97d55"
format_stamp: "Formatted at 2026-08-12 21:02:52 on dist-test-slave-h3ft"
server_key: "09df466e35530dea546f185322419680"
server_key_iv: "2b584933c592aaf4a2af9a375d0d27e2"
server_key_version: "encryptionkey@0"
I20260812 21:02:52.164992 13644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:52.183166 13644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:52.185967 13644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:52.186161 13644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:52.191660 13644 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43143
I20260812 21:02:52.191716 13752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43143 every 8 connection(s)
I20260812 21:02:52.192185 13644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:52.193439 13754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:52.194289 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13644
I20260812 21:02:52.194443 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:52.194698 10361 external_mini_cluster.cc:1428] Setting key 23f56c441f7927c07e453279086bbcaa
I20260812 21:02:52.197615 13754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55: Bootstrap starting.
I20260812 21:02:52.198431 13754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:52.198783 13754 log.cc:824] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:52.199723 13754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55: No bootstrap required, opened a new log
I20260812 21:02:52.202679 13754 raft_consensus.cc:348] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adbe2b3e9d404fb1825a3257ece97d55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } }
I20260812 21:02:52.202845 13754 raft_consensus.cc:374] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:52.202872 13754 raft_consensus.cc:729] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adbe2b3e9d404fb1825a3257ece97d55, State: Initialized, Role: FOLLOWER
I20260812 21:02:52.203047 13754 consensus_queue.cc:260] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adbe2b3e9d404fb1825a3257ece97d55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } }
I20260812 21:02:52.203137 13754 raft_consensus.cc:388] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:52.203163 13754 raft_consensus.cc:482] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
Aug 12 21:02:52 dist-test-slave-h3ft krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 21:02:52.203238 13754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:52.203995 13754 raft_consensus.cc:504] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adbe2b3e9d404fb1825a3257ece97d55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } }
I20260812 21:02:52.204128 13754 leader_election.cc:302] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: adbe2b3e9d404fb1825a3257ece97d55; no voters:
I20260812 21:02:52.204360 13754 leader_election.cc:288] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:52.204429 13762 raft_consensus.cc:2781] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:52.204602 13762 raft_consensus.cc:686] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [term 1 LEADER]: Becoming Leader. State: Replica: adbe2b3e9d404fb1825a3257ece97d55, State: Running, Role: LEADER
I20260812 21:02:52.204692 13754 sys_catalog.cc:564] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:52.204766 13762 consensus_queue.cc:237] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adbe2b3e9d404fb1825a3257ece97d55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } }
I20260812 21:02:52.205322 13763 sys_catalog.cc:455] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "adbe2b3e9d404fb1825a3257ece97d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adbe2b3e9d404fb1825a3257ece97d55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } } }
I20260812 21:02:52.205404 13763 sys_catalog.cc:458] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:52.205646 13765 sys_catalog.cc:455] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader adbe2b3e9d404fb1825a3257ece97d55. Latest consensus state: current_term: 1 leader_uuid: "adbe2b3e9d404fb1825a3257ece97d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adbe2b3e9d404fb1825a3257ece97d55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } } }
I20260812 21:02:52.205768 13765 sys_catalog.cc:458] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55 [sys.catalog]: This master's current role is: LEADER
W20260812 21:02:52.206971 13789 catalog_manager.cc:1558] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:02:52.207094 13789 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:02:52.207176 13776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:52.207468 13776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:52.208499 13758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:52.195552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:42075 (local address 127.0.0.1:43143)
0812 21:02:52.195797 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:52.195807 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:52.195839 (+ 32us) server_negotiation.cc:407] Connection header received
0812 21:02:52.196363 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:52.196371 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:52.196431 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:52.196574 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:52.197615 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:52.198753 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:52.199859 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:52.200334 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:52.200423 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:52.203783 (+ 3360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:52.203789 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:52.203789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:52.203806 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:52.206414 (+ 2608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:52.207041 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:52.207045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:52.207046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:52.207170 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:52.207443 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:52.207444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:52.207444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:52.207797 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:52.207966 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:52.208154 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 21:02:52.208269 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":127,"threads_started":1}
I20260812 21:02:52.209408 13776 catalog_manager.cc:1347] Generated new cluster ID: c1693be90e62444586e9187b4e5734a2
I20260812 21:02:52.209481 13776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:52.209776 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:52.223651 13758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:52.215402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:56619 (local address 127.0.0.1:43143)
0812 21:02:52.215457 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:52.215460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:52.215665 (+ 205us) server_negotiation.cc:407] Connection header received
0812 21:02:52.215731 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:52.215732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:52.215744 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:52.215806 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:52.216577 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:52.217376 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:52.218500 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:52.218843 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:52.218902 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:52.220561 (+ 1659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:52.220562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:52.220563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:52.220570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:52.222286 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:52.222718 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:52.222720 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:52.222720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:52.222788 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:52.223068 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:52.223069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:52.223069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:52.223222 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:52.223355 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:52.223464 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 21:02:52.223538 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 21:02:52.247438 13776 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:52.248147 13776 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:52.256387 13776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P adbe2b3e9d404fb1825a3257ece97d55: Generated new TSK 0
I20260812 21:02:52.256681 13776 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:52.264643 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13644
W20260812 21:02:52.290314 13620 connection.cc:535] client connection to 127.0.0.1:43143 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43143): Connection reset by peer (error 104)
2026-08-12T21:02:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1785 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:52 dist-test-slave-h3ft krb5kdc[13812](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:52 dist-test-slave-h3ft krb5kdc[13812](info): set up 2 sockets
Aug 12 21:02:52 dist-test-slave-h3ft krb5kdc[13812](info): commencing operation
krb5kdc: starting...
W20260812 21:02:53.643520 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.006s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:53 dist-test-slave-h3ft krb5kdc[13812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:53.803231 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45233
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:53.906870 13830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:53.907215 13830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:53.907263 13830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:53.908586 13830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:53.908663 13830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:53.908689 13830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:53.908723 13830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:53.908757 13830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:53.910624 13830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:53.910993 13830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:53.911315 13830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:53.917330 13842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:53.917323 13844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:53.917361 13838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:53.917523 13830 server_base.cc:1034] running on GCE node
I20260812 21:02:53.917977 13830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:53.918368 13830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:53.919564 13830 hybrid_clock.cc:648] HybridClock initialized: now 1786568573919548 us; error 48 us; skew 500 ppm
Aug 12 21:02:53 dist-test-slave-h3ft krb5kdc[13812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568573, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:53.922755 13830 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:53.923377 13830 webserver.cc:460] Webserver started at http://127.0.0.1:38437/ using document root <none> and password file <none>
I20260812 21:02:53.923666 13830 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:53.923743 13830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:53.923986 13830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:53.925343 13830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "5bab76a9c80446b2b178a25c646e7ab8"
format_stamp: "Formatted at 2026-08-12 21:02:53 on dist-test-slave-h3ft"
server_key: "d5aacaaf4e359ca1d3870a8c4401aaaf"
server_key_iv: "bde064580cc8fa99ec341c87d4304fcc"
server_key_version: "encryptionkey@0"
I20260812 21:02:53.925808 13830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "5bab76a9c80446b2b178a25c646e7ab8"
format_stamp: "Formatted at 2026-08-12 21:02:53 on dist-test-slave-h3ft"
server_key: "d5aacaaf4e359ca1d3870a8c4401aaaf"
server_key_iv: "bde064580cc8fa99ec341c87d4304fcc"
server_key_version: "encryptionkey@0"
I20260812 21:02:53.927528 13830 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260812 21:02:53.928547 13858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:53.928800 13830 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:53.928994 13830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "5bab76a9c80446b2b178a25c646e7ab8"
format_stamp: "Formatted at 2026-08-12 21:02:53 on dist-test-slave-h3ft"
server_key: "d5aacaaf4e359ca1d3870a8c4401aaaf"
server_key_iv: "bde064580cc8fa99ec341c87d4304fcc"
server_key_version: "encryptionkey@0"
I20260812 21:02:53.929095 13830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:53.937867 13830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:53.940663 13830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:53.940872 13830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:53.946298 13830 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45233
I20260812 21:02:53.946367 13948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45233 every 8 connection(s)
I20260812 21:02:53.946837 13830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:53.948081 13949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:53.950958 13949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8: Bootstrap starting.
I20260812 21:02:53.951550 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 13830
I20260812 21:02:53.951660 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:53.951857 13949 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:53.951984 10361 external_mini_cluster.cc:1428] Setting key ff80e085641fb68bf9ad20a66e2b8085
I20260812 21:02:53.952270 13949 log.cc:824] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:53.953286 13949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8: No bootstrap required, opened a new log
I20260812 21:02:53.955905 13949 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bab76a9c80446b2b178a25c646e7ab8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45233 } }
I20260812 21:02:53.956308 13949 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:53.956373 13949 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bab76a9c80446b2b178a25c646e7ab8, State: Initialized, Role: FOLLOWER
I20260812 21:02:53.956573 13949 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bab76a9c80446b2b178a25c646e7ab8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45233 } }
I20260812 21:02:53.956679 13949 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:53.956714 13949 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:53.956758 13949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:53.958248 13949 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bab76a9c80446b2b178a25c646e7ab8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45233 } }
I20260812 21:02:53.958425 13949 leader_election.cc:302] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bab76a9c80446b2b178a25c646e7ab8; no voters:
I20260812 21:02:53.958726 13949 leader_election.cc:288] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:53.958837 13955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:53.959128 13955 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [term 1 LEADER]: Becoming Leader. State: Replica: 5bab76a9c80446b2b178a25c646e7ab8, State: Running, Role: LEADER
I20260812 21:02:53.959271 13955 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bab76a9c80446b2b178a25c646e7ab8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45233 } }
I20260812 21:02:53.959290 13949 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:53.959735 13953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:53.952695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:50507 (local address 127.0.0.1:45233)
0812 21:02:53.952915 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:53.952926 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:53.952970 (+ 44us) server_negotiation.cc:407] Connection header received
0812 21:02:53.953582 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:53.953590 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:53.953649 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:53.953789 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:53.954075 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:53.955158 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:53.956539 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:53.957282 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:53.957510 (+ 228us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:53.958646 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:53.958653 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:53.958653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:53.958931 (+ 278us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:53.958993 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:53.959036 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:53.959383 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:53.959435 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 21:02:53.959471 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":97,"threads_started":1}
I20260812 21:02:53.960199 13957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bab76a9c80446b2b178a25c646e7ab8. Latest consensus state: current_term: 1 leader_uuid: "5bab76a9c80446b2b178a25c646e7ab8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bab76a9c80446b2b178a25c646e7ab8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45233 } } }
I20260812 21:02:53.960422 13957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:53.960435 13956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bab76a9c80446b2b178a25c646e7ab8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bab76a9c80446b2b178a25c646e7ab8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45233 } } }
I20260812 21:02:53.960745 13956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:53.960785 13970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:53.961233 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:53.961475 13970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:53.964188 13970 catalog_manager.cc:1347] Generated new cluster ID: 1f478c3f7c3a4adb88541463dc268140
I20260812 21:02:53.964267 13970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:53.967796 13953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:53.963406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:51745 (local address 127.0.0.1:45233)
0812 21:02:53.963451 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:53.963453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:53.963631 (+ 178us) server_negotiation.cc:407] Connection header received
0812 21:02:53.963661 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:53.963661 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:53.963673 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:53.963775 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:53.963975 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:53.964783 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:53.965929 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:53.966269 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:53.966309 (+ 40us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:53.967490 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:53.967492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:53.967492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:53.967500 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:53.967521 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:53.967527 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:53.967560 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:53.967682 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 21:02:53.967697 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 21:02:53.969146 13970 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:53.969743 13970 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:53.978444 13970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bab76a9c80446b2b178a25c646e7ab8: Generated new TSK 0
I20260812 21:02:53.978709 13970 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:53.984390 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 13830
W20260812 21:02:54.008419 13806 connection.cc:535] client connection to 127.0.0.1:45233 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45233): Connection reset by peer (error 104)
2026-08-12T21:02:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1718 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:54 dist-test-slave-h3ft krb5kdc[14005](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:54 dist-test-slave-h3ft krb5kdc[14005](info): set up 2 sockets
Aug 12 21:02:54 dist-test-slave-h3ft krb5kdc[14005](info): commencing operation
krb5kdc: starting...
W20260812 21:02:55.358822 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.335s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:55 dist-test-slave-h3ft krb5kdc[14005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:55.518944 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38837
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:55.617421 14033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:55.617717 14033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:55.617745 14033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:55.619163 14033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:55.619215 14033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:55.619230 14033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:55.619243 14033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:55.619256 14033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:55.621019 14033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:55.621348 14033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:55.621702 14033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:55.627681 14038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:55.627671 14041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:55.627674 14039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:55.628041 14033 server_base.cc:1034] running on GCE node
I20260812 21:02:55.628369 14033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:55.628752 14033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:55.629993 14033 hybrid_clock.cc:648] HybridClock initialized: now 1786568575629973 us; error 35 us; skew 500 ppm
Aug 12 21:02:55 dist-test-slave-h3ft krb5kdc[14005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568575, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:55.638334 14033 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:55.639057 14033 webserver.cc:460] Webserver started at http://127.0.0.1:45481/ using document root <none> and password file <none>
I20260812 21:02:55.639379 14033 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:55.639465 14033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:55.639657 14033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:55.641074 14033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "71035f58caeb46578b5a0b5b3ed5e492"
format_stamp: "Formatted at 2026-08-12 21:02:55 on dist-test-slave-h3ft"
server_key: "924fe6475e8e143d29721b8dfeae8d9e"
server_key_iv: "309781ffd8ed76d3d0c9877399fa79ea"
server_key_version: "encryptionkey@0"
I20260812 21:02:55.641582 14033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "71035f58caeb46578b5a0b5b3ed5e492"
format_stamp: "Formatted at 2026-08-12 21:02:55 on dist-test-slave-h3ft"
server_key: "924fe6475e8e143d29721b8dfeae8d9e"
server_key_iv: "309781ffd8ed76d3d0c9877399fa79ea"
server_key_version: "encryptionkey@0"
I20260812 21:02:55.643462 14033 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:02:55.644655 14054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:55.644924 14033 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:55.645072 14033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "71035f58caeb46578b5a0b5b3ed5e492"
format_stamp: "Formatted at 2026-08-12 21:02:55 on dist-test-slave-h3ft"
server_key: "924fe6475e8e143d29721b8dfeae8d9e"
server_key_iv: "309781ffd8ed76d3d0c9877399fa79ea"
server_key_version: "encryptionkey@0"
I20260812 21:02:55.645174 14033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:55.649521 14033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:55.652051 14033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:55.652247 14033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:55.657475 14033 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38837
I20260812 21:02:55.657516 14139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38837 every 8 connection(s)
I20260812 21:02:55.658026 14033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:55.659451 14140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:55.662367 14140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492: Bootstrap starting.
I20260812 21:02:55.663214 14140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:55.663551 14140 log.cc:824] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:55.664531 14140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492: No bootstrap required, opened a new log
I20260812 21:02:55.666543 14140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71035f58caeb46578b5a0b5b3ed5e492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38837 } }
I20260812 21:02:55.666738 14140 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:55.666764 14140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71035f58caeb46578b5a0b5b3ed5e492, State: Initialized, Role: FOLLOWER
I20260812 21:02:55.666965 14140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71035f58caeb46578b5a0b5b3ed5e492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38837 } }
I20260812 21:02:55.667129 14140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:55.667161 14140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:55.667199 14140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:55.667917 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14033
I20260812 21:02:55.667965 14140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71035f58caeb46578b5a0b5b3ed5e492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38837 } }
I20260812 21:02:55.668147 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:55.668123 14140 leader_election.cc:302] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71035f58caeb46578b5a0b5b3ed5e492; no voters:
I20260812 21:02:55.668404 10361 external_mini_cluster.cc:1428] Setting key b865cc6d74a43e17035831a7d484a7b4
I20260812 21:02:55.668403 14140 leader_election.cc:288] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:55.668442 14145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:55.668653 14145 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [term 1 LEADER]: Becoming Leader. State: Replica: 71035f58caeb46578b5a0b5b3ed5e492, State: Running, Role: LEADER
I20260812 21:02:55.668833 14140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:55.668810 14145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71035f58caeb46578b5a0b5b3ed5e492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38837 } }
I20260812 21:02:55.669319 14148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71035f58caeb46578b5a0b5b3ed5e492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71035f58caeb46578b5a0b5b3ed5e492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38837 } } }
I20260812 21:02:55.669406 14148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:55.669708 14157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:55.669741 14150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71035f58caeb46578b5a0b5b3ed5e492. Latest consensus state: current_term: 1 leader_uuid: "71035f58caeb46578b5a0b5b3ed5e492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71035f58caeb46578b5a0b5b3ed5e492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38837 } } }
I20260812 21:02:55.669853 14150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:55.670547 14157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:55.672026 14156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:55.669339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:57943 (local address 127.0.0.1:38837)
0812 21:02:55.669650 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:55.669663 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:55.669708 (+ 45us) server_negotiation.cc:407] Connection header received
0812 21:02:55.669891 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:55.669900 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:55.669942 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:55.670511 (+ 569us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:55.671216 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:55.671220 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:55.671220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:55.671225 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:55.671273 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:55.671292 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:55.671716 (+ 424us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:55.671764 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 21:02:55.671825 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":119,"threads_started":1}
I20260812 21:02:55.672719 14157 catalog_manager.cc:1347] Generated new cluster ID: 45e5316694b34bfb857552523c8afbc0
I20260812 21:02:55.672827 14157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:55.673336 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:55.676707 14156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:55.675292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:42869 (local address 127.0.0.1:38837)
0812 21:02:55.675371 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:55.675374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:55.675509 (+ 135us) server_negotiation.cc:407] Connection header received
0812 21:02:55.675566 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:55.675567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:55.675575 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:55.675645 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:55.676423 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:55.676425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:55.676425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:55.676429 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:55.676451 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:55.676457 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:55.676530 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:55.676589 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 21:02:55.676606 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 21:02:55.705400 14157 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:55.705753 14157 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:55.709833 14157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71035f58caeb46578b5a0b5b3ed5e492: Generated new TSK 0
I20260812 21:02:55.710166 14157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:55.717957 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14033
2026-08-12T21:02:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1732 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:55 dist-test-slave-h3ft krb5kdc[14196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:55 dist-test-slave-h3ft krb5kdc[14196](info): set up 2 sockets
Aug 12 21:02:55 dist-test-slave-h3ft krb5kdc[14196](info): commencing operation
krb5kdc: starting...
W20260812 21:02:57.101799 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:57 dist-test-slave-h3ft krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:57.259500 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38525
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:57.361029 14223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:57.361464 14223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:57.361521 14223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:57.362988 14223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:57.363124 14223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:57.363154 14223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:57.363190 14223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:57.363225 14223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:57.365079 14223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38525
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:57.365461 14223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:57.365782 14223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:57.372601 14235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:57.372611 14232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:57.372625 14231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:57.372872 14223 server_base.cc:1034] running on GCE node
I20260812 21:02:57.373340 14223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:57.373719 14223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:57.374909 14223 hybrid_clock.cc:648] HybridClock initialized: now 1786568577374882 us; error 43 us; skew 500 ppm
Aug 12 21:02:57 dist-test-slave-h3ft krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568577, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:57.378362 14223 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:57.379205 14223 webserver.cc:460] Webserver started at http://127.0.0.1:46175/ using document root <none> and password file <none>
I20260812 21:02:57.379493 14223 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:57.379561 14223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:57.379727 14223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:57.381142 14223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "c3243838fac545d39618cfcdf78270b4"
format_stamp: "Formatted at 2026-08-12 21:02:57 on dist-test-slave-h3ft"
server_key: "7ecb334da683361f1341b7bb1fcdbdf6"
server_key_iv: "0bc788d33cab27db700a6be821fe2752"
server_key_version: "encryptionkey@0"
I20260812 21:02:57.381605 14223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "c3243838fac545d39618cfcdf78270b4"
format_stamp: "Formatted at 2026-08-12 21:02:57 on dist-test-slave-h3ft"
server_key: "7ecb334da683361f1341b7bb1fcdbdf6"
server_key_iv: "0bc788d33cab27db700a6be821fe2752"
server_key_version: "encryptionkey@0"
I20260812 21:02:57.383464 14223 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 21:02:57.384575 14247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:57.384925 14223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:57.385084 14223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "c3243838fac545d39618cfcdf78270b4"
format_stamp: "Formatted at 2026-08-12 21:02:57 on dist-test-slave-h3ft"
server_key: "7ecb334da683361f1341b7bb1fcdbdf6"
server_key_iv: "0bc788d33cab27db700a6be821fe2752"
server_key_version: "encryptionkey@0"
I20260812 21:02:57.385183 14223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:57.398613 14223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:57.402554 14223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:57.402855 14223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:57.408946 14223 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38525
I20260812 21:02:57.408965 14329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38525 every 8 connection(s)
I20260812 21:02:57.409772 14223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:57.411350 14331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:57.414729 14331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4: Bootstrap starting.
I20260812 21:02:57.415678 14331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:57.416011 14331 log.cc:824] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:57.417150 14331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4: No bootstrap required, opened a new log
I20260812 21:02:57.417965 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14223
I20260812 21:02:57.418133 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:57.418416 10361 external_mini_cluster.cc:1428] Setting key 54e119678ca91c35396b9d9135e797dc
I20260812 21:02:57.419960 14331 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3243838fac545d39618cfcdf78270b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260812 21:02:57.420182 14331 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:57.420226 14331 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3243838fac545d39618cfcdf78270b4, State: Initialized, Role: FOLLOWER
I20260812 21:02:57.420392 14331 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3243838fac545d39618cfcdf78270b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260812 21:02:57.420496 14331 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:57.420538 14331 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:57.420589 14331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:57.421854 14331 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3243838fac545d39618cfcdf78270b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260812 21:02:57.422032 14331 leader_election.cc:302] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3243838fac545d39618cfcdf78270b4; no voters:
I20260812 21:02:57.422257 14331 leader_election.cc:288] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:57.422317 14338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:57.422501 14338 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [term 1 LEADER]: Becoming Leader. State: Replica: c3243838fac545d39618cfcdf78270b4, State: Running, Role: LEADER
I20260812 21:02:57.422619 14338 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3243838fac545d39618cfcdf78270b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260812 21:02:57.422617 14331 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:57.423715 14339 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3243838fac545d39618cfcdf78270b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3243838fac545d39618cfcdf78270b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } } }
I20260812 21:02:57.423825 14339 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:57.424000 14340 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3243838fac545d39618cfcdf78270b4. Latest consensus state: current_term: 1 leader_uuid: "c3243838fac545d39618cfcdf78270b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3243838fac545d39618cfcdf78270b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } } }
I20260812 21:02:57.424073 14340 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:57.424209 14358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:57.424865 14358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 21:02:57 dist-test-slave-h3ft krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 21:02:57.427603 14358 catalog_manager.cc:1347] Generated new cluster ID: df982e0714a54e32b9a28fda5f40a5b5
I20260812 21:02:57.427670 14358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:57.432392 14336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:57.419262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:40145 (local address 127.0.0.1:38525)
0812 21:02:57.419545 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:57.419560 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:57.419613 (+ 53us) server_negotiation.cc:407] Connection header received
0812 21:02:57.419975 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:57.419985 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:57.420057 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:57.420306 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:57.421203 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:57.422336 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:57.423467 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:57.424176 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:57.424696 (+ 520us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:57.427652 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:57.427657 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:57.427657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:57.427673 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:57.430137 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:57.430706 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:57.430710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:57.430711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:57.430886 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:57.431196 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:57.431197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:57.431197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:57.431632 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:57.431841 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:57.431955 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 21:02:57.432088 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":127,"threads_started":1}
I20260812 21:02:57.433773 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:57.435721 14358 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:57.436532 14358 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:57.444715 14358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3243838fac545d39618cfcdf78270b4: Generated new TSK 0
I20260812 21:02:57.445003 14358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:57.447430 14336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:57.439487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:58775 (local address 127.0.0.1:38525)
0812 21:02:57.439548 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:57.439551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:57.439775 (+ 224us) server_negotiation.cc:407] Connection header received
0812 21:02:57.439881 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:57.439882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:57.439902 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:57.439973 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:57.440655 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:57.441272 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:57.442071 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:57.442324 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:57.442431 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:57.443925 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:57.443927 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:57.443927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:02:57.443936 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:57.445761 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:57.446363 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:57.446365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:57.446365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:57.446448 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:02:57.446692 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:02:57.446693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:02:57.446693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:02:57.446845 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:57.446962 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:57.447233 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 21:02:57.447313 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":27}
I20260812 21:02:57.450044 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14223
W20260812 21:02:57.489065 14194 connection.cc:535] client connection to 127.0.0.1:38525 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38525): Connection reset by peer (error 104)
2026-08-12T21:02:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1748 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:57 dist-test-slave-h3ft krb5kdc[14385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:57 dist-test-slave-h3ft krb5kdc[14385](info): set up 2 sockets
Aug 12 21:02:57 dist-test-slave-h3ft krb5kdc[14385](info): commencing operation
krb5kdc: starting...
W20260812 21:02:58.848706 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.344s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:02:58 dist-test-slave-h3ft krb5kdc[14385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:02:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:02:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:02:59.015362 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40811
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:02:59.117314 14400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:02:59.117693 14400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:02:59.117748 14400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:02:59.119334 14400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:02:59.119428 14400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:02:59.119468 14400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:02:59.119506 14400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:02:59.119532 14400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:02:59.121526 14400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40811
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:02:59.121953 14400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:02:59.122285 14400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:02:59.129148 14410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:59.129150 14412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:02:59.129150 14407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:02:59.129446 14400 server_base.cc:1034] running on GCE node
I20260812 21:02:59.129803 14400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:02:59.130225 14400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:02:59.131428 14400 hybrid_clock.cc:648] HybridClock initialized: now 1786568579131398 us; error 50 us; skew 500 ppm
Aug 12 21:02:59 dist-test-slave-h3ft krb5kdc[14385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568579, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:02:59.135214 14400 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:02:59.135833 14400 webserver.cc:460] Webserver started at http://127.0.0.1:45335/ using document root <none> and password file <none>
I20260812 21:02:59.136160 14400 fs_manager.cc:359] Metadata directory not provided
I20260812 21:02:59.136215 14400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:02:59.136369 14400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:02:59.137732 14400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "7d8dfc81262e40e5980b412836956a96"
format_stamp: "Formatted at 2026-08-12 21:02:59 on dist-test-slave-h3ft"
server_key: "40f4f7f3a9b200903d5c941dc5bca942"
server_key_iv: "bd9f38fa119e799026abf5bd7de08144"
server_key_version: "encryptionkey@0"
I20260812 21:02:59.138163 14400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "7d8dfc81262e40e5980b412836956a96"
format_stamp: "Formatted at 2026-08-12 21:02:59 on dist-test-slave-h3ft"
server_key: "40f4f7f3a9b200903d5c941dc5bca942"
server_key_iv: "bd9f38fa119e799026abf5bd7de08144"
server_key_version: "encryptionkey@0"
I20260812 21:02:59.140103 14400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:02:59.141100 14421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:02:59.141366 14400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:02:59.141491 14400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "7d8dfc81262e40e5980b412836956a96"
format_stamp: "Formatted at 2026-08-12 21:02:59 on dist-test-slave-h3ft"
server_key: "40f4f7f3a9b200903d5c941dc5bca942"
server_key_iv: "bd9f38fa119e799026abf5bd7de08144"
server_key_version: "encryptionkey@0"
I20260812 21:02:59.141566 14400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:02:59.155200 14400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:02:59.158126 14400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:02:59.158295 14400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:02:59.164022 14400 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40811
I20260812 21:02:59.164151 14517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40811 every 8 connection(s)
I20260812 21:02:59.164620 14400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:02:59.165838 14518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:02:59.168812 14518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96: Bootstrap starting.
I20260812 21:02:59.169577 14518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96: Neither blocks nor log segments found. Creating new log.
I20260812 21:02:59.169972 14518 log.cc:824] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96: Log is configured to *not* fsync() on all Append() calls
I20260812 21:02:59.170928 14518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96: No bootstrap required, opened a new log
I20260812 21:02:59.172950 14518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8dfc81262e40e5980b412836956a96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40811 } }
I20260812 21:02:59.173163 14518 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:02:59.173218 14518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d8dfc81262e40e5980b412836956a96, State: Initialized, Role: FOLLOWER
I20260812 21:02:59.173441 14518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8dfc81262e40e5980b412836956a96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40811 } }
I20260812 21:02:59.173559 14518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:02:59.173609 14518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:02:59.173663 14518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:02:59.173894 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14400
I20260812 21:02:59.174038 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:02:59.174305 10361 external_mini_cluster.cc:1428] Setting key 6adeddd983982aba1776be37ef968368
I20260812 21:02:59.174572 14518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8dfc81262e40e5980b412836956a96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40811 } }
I20260812 21:02:59.174713 14518 leader_election.cc:302] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d8dfc81262e40e5980b412836956a96; no voters:
I20260812 21:02:59.174975 14518 leader_election.cc:288] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:02:59.175264 14527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:02:59.175405 14518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:02:59.175436 14527 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [term 1 LEADER]: Becoming Leader. State: Replica: 7d8dfc81262e40e5980b412836956a96, State: Running, Role: LEADER
I20260812 21:02:59.175547 14527 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8dfc81262e40e5980b412836956a96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40811 } }
I20260812 21:02:59.175984 14527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d8dfc81262e40e5980b412836956a96. Latest consensus state: current_term: 1 leader_uuid: "7d8dfc81262e40e5980b412836956a96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8dfc81262e40e5980b412836956a96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40811 } } }
I20260812 21:02:59.176088 14527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [sys.catalog]: This master's current role is: LEADER
I20260812 21:02:59.176225 14523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d8dfc81262e40e5980b412836956a96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8dfc81262e40e5980b412836956a96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40811 } } }
I20260812 21:02:59.176326 14523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96 [sys.catalog]: This master's current role is: LEADER
W20260812 21:02:59.177753 14550 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:02:59.177824 14550 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:02:59.177876 14540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:02:59.178089 14540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:02:59.180264 14540 catalog_manager.cc:1347] Generated new cluster ID: f76351ed00214b5dbb6aa08d437b6250
I20260812 21:02:59.180342 14540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:02:59.181937 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:59.175115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:39535 (local address 127.0.0.1:40811)
0812 21:02:59.175551 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:59.175566 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:59.175617 (+ 51us) server_negotiation.cc:407] Connection header received
0812 21:02:59.175802 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:59.175812 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:59.175900 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:59.176557 (+ 657us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:59.176683 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:59.178235 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:59.179539 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:59.180099 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:59.180292 (+ 193us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:59.181144 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:59.181149 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:59.181149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:59.181367 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:59.181416 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:59.181428 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:59.181531 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:59.181617 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 21:02:59.181650 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":117,"threads_started":1}
I20260812 21:02:59.183175 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:02:59.188493 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:02:59.184854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:33949 (local address 127.0.0.1:40811)
0812 21:02:59.184949 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 21:02:59.184952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:02:59.185012 (+ 60us) server_negotiation.cc:407] Connection header received
0812 21:02:59.185090 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:02:59.185091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:02:59.185103 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:02:59.185160 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:02:59.185333 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:59.186227 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:59.187061 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:02:59.187299 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:02:59.187389 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:02:59.188194 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:02:59.188195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:02:59.188195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:02:59.188202 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:02:59.188220 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:02:59.188225 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:02:59.188285 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 21:02:59.188364 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 21:02:59.188381 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 21:02:59.213040 14540 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:02:59.213744 14540 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:02:59.226954 14540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d8dfc81262e40e5980b412836956a96: Generated new TSK 0
I20260812 21:02:59.227348 14540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:02:59.230671 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14400
W20260812 21:02:59.265525 14382 connection.cc:535] client connection to 127.0.0.1:40811 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40811): Connection reset by peer (error 104)
2026-08-12T21:02:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1776 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:02:59 dist-test-slave-h3ft krb5kdc[14567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:02:59 dist-test-slave-h3ft krb5kdc[14567](info): set up 2 sockets
Aug 12 21:02:59 dist-test-slave-h3ft krb5kdc[14567](info): commencing operation
krb5kdc: starting...
W20260812 21:03:00.603972 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:00 dist-test-slave-h3ft krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 21:03:00.768270 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36421
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:00.876863 14582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:00.877166 14582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:00.877193 14582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:00.878518 14582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:00.878571 14582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:00.878587 14582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:00.878599 14582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:00.878612 14582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:00.880381 14582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36421
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:00.880671 14582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:00.880915 14582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:00.886893 14596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:00.886946 14594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:00.887313 14582 server_base.cc:1034] running on GCE node
W20260812 21:03:00.886895 14592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:00.887707 14582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:00.888089 14582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:00.889272 14582 hybrid_clock.cc:648] HybridClock initialized: now 1786568580889260 us; error 50 us; skew 500 ppm
Aug 12 21:03:00 dist-test-slave-h3ft krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568580, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:00.900081 14582 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 21:03:00.900786 14582 webserver.cc:460] Webserver started at http://127.0.0.1:37211/ using document root <none> and password file <none>
I20260812 21:03:00.901106 14582 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:00.901187 14582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:00.901366 14582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:00.902726 14582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "8200bbfe41d141328e226cc538359de5"
format_stamp: "Formatted at 2026-08-12 21:03:00 on dist-test-slave-h3ft"
server_key: "fff50c3596ebcbcf2f33aaedcdf21862"
server_key_iv: "0738ac23840a115281d4f30d18c04cd4"
server_key_version: "encryptionkey@0"
I20260812 21:03:00.903228 14582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "8200bbfe41d141328e226cc538359de5"
format_stamp: "Formatted at 2026-08-12 21:03:00 on dist-test-slave-h3ft"
server_key: "fff50c3596ebcbcf2f33aaedcdf21862"
server_key_iv: "0738ac23840a115281d4f30d18c04cd4"
server_key_version: "encryptionkey@0"
I20260812 21:03:00.904996 14582 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 21:03:00.906075 14615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:00.906363 14582 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:03:00.906497 14582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "8200bbfe41d141328e226cc538359de5"
format_stamp: "Formatted at 2026-08-12 21:03:00 on dist-test-slave-h3ft"
server_key: "fff50c3596ebcbcf2f33aaedcdf21862"
server_key_iv: "0738ac23840a115281d4f30d18c04cd4"
server_key_version: "encryptionkey@0"
I20260812 21:03:00.906606 14582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:00.910832 14582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:00.913690 14582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:00.913887 14582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:00.919413 14582 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36421
I20260812 21:03:00.919452 14704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36421 every 8 connection(s)
I20260812 21:03:00.919902 14582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:00.921175 14706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:00.924165 14706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5: Bootstrap starting.
I20260812 21:03:00.924893 14706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:00.925269 14706 log.cc:824] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:00.926155 14706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5: No bootstrap required, opened a new log
I20260812 21:03:00.926944 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14582
I20260812 21:03:00.927263 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:00.927528 10361 external_mini_cluster.cc:1428] Setting key d5df261fbcc1e1e5051980c7e7d83248
I20260812 21:03:00.928591 14706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8200bbfe41d141328e226cc538359de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36421 } }
I20260812 21:03:00.928768 14706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:03:00.928793 14706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8200bbfe41d141328e226cc538359de5, State: Initialized, Role: FOLLOWER
I20260812 21:03:00.928961 14706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8200bbfe41d141328e226cc538359de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36421 } }
I20260812 21:03:00.929072 14706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:03:00.929142 14706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:03:00.929227 14706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:00.930418 14713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:00.928296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:47199 (local address 127.0.0.1:36421)
0812 21:03:00.928554 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:00.928565 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:00.928603 (+ 38us) server_negotiation.cc:407] Connection header received
0812 21:03:00.928723 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:00.928730 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:00.928758 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:00.929048 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:00.929907 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:00.929912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:00.929912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:00.929917 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:00.929971 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:00.929984 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:00.930075 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:00.930156 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 21:03:00.930209 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":146,"threads_started":1}
I20260812 21:03:00.930429 14706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8200bbfe41d141328e226cc538359de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36421 } }
I20260812 21:03:00.930613 14706 leader_election.cc:302] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8200bbfe41d141328e226cc538359de5; no voters:
I20260812 21:03:00.930845 14706 leader_election.cc:288] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:03:00.930946 14716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:00.931226 14706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:00.931247 14716 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [term 1 LEADER]: Becoming Leader. State: Replica: 8200bbfe41d141328e226cc538359de5, State: Running, Role: LEADER
I20260812 21:03:00.931505 14716 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8200bbfe41d141328e226cc538359de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36421 } }
I20260812 21:03:00.931656 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:00.932004 14716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8200bbfe41d141328e226cc538359de5. Latest consensus state: current_term: 1 leader_uuid: "8200bbfe41d141328e226cc538359de5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8200bbfe41d141328e226cc538359de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36421 } } }
I20260812 21:03:00.932093 14716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:00.932374 14726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:00.933415 14726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:03:00.933497 14717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8200bbfe41d141328e226cc538359de5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8200bbfe41d141328e226cc538359de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36421 } } }
I20260812 21:03:00.933602 14717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:00.935784 14713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:00.934225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:46555 (local address 127.0.0.1:36421)
0812 21:03:00.934267 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:00.934270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:00.934457 (+ 187us) server_negotiation.cc:407] Connection header received
0812 21:03:00.934532 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:00.934534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:00.934542 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:00.934596 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:00.935496 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:00.935498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:00.935498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:00.935504 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:00.935525 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:00.935531 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:00.935613 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:00.935679 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 21:03:00.935700 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 21:03:00.935801 14726 catalog_manager.cc:1347] Generated new cluster ID: f7c93e3df46c482d8b81ee14fdbbd70d
I20260812 21:03:00.935902 14726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:03:00.956008 14726 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:00.956298 14726 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:00.960566 14726 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8200bbfe41d141328e226cc538359de5: Generated new TSK 0
I20260812 21:03:00.960897 14726 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:03:00.969769 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14582
2026-08-12T21:03:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1735 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:03:01 dist-test-slave-h3ft krb5kdc[14753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:03:01 dist-test-slave-h3ft krb5kdc[14753](info): set up 2 sockets
Aug 12 21:03:01 dist-test-slave-h3ft krb5kdc[14753](info): commencing operation
krb5kdc: starting...
W20260812 21:03:02.383489 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.367s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:02 dist-test-slave-h3ft krb5kdc[14753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:03:02.547549 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:46651
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:37049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:46651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:02.654990 14772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:02.655295 14772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:02.655323 14772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:02.656687 14772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:02.656745 14772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:02.656761 14772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:02.656774 14772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:02.656786 14772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:02.658567 14772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:46651
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:46651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:02.658877 14772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:02.659189 14772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:02.665324 14783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:02.665324 14779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:02.665335 14778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:02.665580 14772 server_base.cc:1034] running on GCE node
I20260812 21:03:02.665874 14772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:02.666287 14772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:02.667445 14772 hybrid_clock.cc:648] HybridClock initialized: now 1786568582667421 us; error 39 us; skew 500 ppm
Aug 12 21:03:02 dist-test-slave-h3ft krb5kdc[14753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568582, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:02.670725 14772 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:03:02.671370 14772 webserver.cc:460] Webserver started at http://127.10.30.126:38155/ using document root <none> and password file <none>
I20260812 21:03:02.671679 14772 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:02.671731 14772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:02.671976 14772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:02.673368 14772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "8babe114ad9843ae82612cbf9d085efa"
format_stamp: "Formatted at 2026-08-12 21:03:02 on dist-test-slave-h3ft"
server_key: "80eaa9338f3134fddcdfb5401d1f03e9"
server_key_iv: "c83857f27ca9e9e90dbf9843400cb31b"
server_key_version: "encryptionkey@0"
I20260812 21:03:02.673813 14772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "8babe114ad9843ae82612cbf9d085efa"
format_stamp: "Formatted at 2026-08-12 21:03:02 on dist-test-slave-h3ft"
server_key: "80eaa9338f3134fddcdfb5401d1f03e9"
server_key_iv: "c83857f27ca9e9e90dbf9843400cb31b"
server_key_version: "encryptionkey@0"
I20260812 21:03:02.675565 14772 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:03:02.676599 14794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:02.676891 14772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:03:02.677000 14772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "8babe114ad9843ae82612cbf9d085efa"
format_stamp: "Formatted at 2026-08-12 21:03:02 on dist-test-slave-h3ft"
server_key: "80eaa9338f3134fddcdfb5401d1f03e9"
server_key_iv: "c83857f27ca9e9e90dbf9843400cb31b"
server_key_version: "encryptionkey@0"
I20260812 21:03:02.677085 14772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:02.692930 14772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:02.696823 14772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:02.697083 14772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:02.706844 14772 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:46651
I20260812 21:03:02.706869 14876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:46651 every 8 connection(s)
I20260812 21:03:02.707517 14772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:02.709017 14877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:02.712356 14877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa: Bootstrap starting.
I20260812 21:03:02.713141 14877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:02.713446 14877 log.cc:824] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:02.714403 14877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa: No bootstrap required, opened a new log
I20260812 21:03:02.716004 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14772
I20260812 21:03:02.716173 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:02.716380 10361 external_mini_cluster.cc:1428] Setting key aac08319a51b1ed7f6f59f6a373529c3
I20260812 21:03:02.716727 14877 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8babe114ad9843ae82612cbf9d085efa" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46651 } }
I20260812 21:03:02.717007 14877 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:03:02.717110 14877 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8babe114ad9843ae82612cbf9d085efa, State: Initialized, Role: FOLLOWER
I20260812 21:03:02.717325 14877 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8babe114ad9843ae82612cbf9d085efa" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46651 } }
I20260812 21:03:02.717479 14877 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:03:02.717532 14877 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:03:02.717593 14877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:02.719097 14877 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8babe114ad9843ae82612cbf9d085efa" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46651 } }
I20260812 21:03:02.719238 14877 leader_election.cc:302] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8babe114ad9843ae82612cbf9d085efa; no voters:
I20260812 21:03:02.719465 14877 leader_election.cc:288] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:03:02.719521 14887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:02.719731 14887 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [term 1 LEADER]: Becoming Leader. State: Replica: 8babe114ad9843ae82612cbf9d085efa, State: Running, Role: LEADER
I20260812 21:03:02.719795 14877 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:02.719871 14887 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8babe114ad9843ae82612cbf9d085efa" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46651 } }
I20260812 21:03:02.720297 14887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8babe114ad9843ae82612cbf9d085efa. Latest consensus state: current_term: 1 leader_uuid: "8babe114ad9843ae82612cbf9d085efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8babe114ad9843ae82612cbf9d085efa" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46651 } } }
I20260812 21:03:02.720424 14887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:02.721225 14889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8babe114ad9843ae82612cbf9d085efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8babe114ad9843ae82612cbf9d085efa" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 46651 } } }
I20260812 21:03:02.721344 14889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:02.721470 14893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:02.722114 14893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 21:03:02 dist-test-slave-h3ft krb5kdc[14753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:03:02.725607 14893 catalog_manager.cc:1347] Generated new cluster ID: a84f4c2dc2774c458d9a263a1036b889
I20260812 21:03:02.725697 14893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:03:02.730185 14886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:02.717053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43035 (local address 127.10.30.126:46651)
0812 21:03:02.717306 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:02.717315 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:02.717348 (+ 33us) server_negotiation.cc:407] Connection header received
0812 21:03:02.717464 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:02.717471 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:02.717557 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:02.717740 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:02.718674 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:02.720170 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:02.721130 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:02.721844 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:02.722030 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:02.725558 (+ 3528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:02.725562 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:02.725562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:02.725577 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:02.728001 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:02.728643 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:02.728647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:02.728648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:02.728792 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:02.729060 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:02.729061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:02.729062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:02.729368 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:02.729631 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:02.729765 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 21:03:02.729907 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":117,"threads_started":1}
I20260812 21:03:02.731606 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:02.740943 14886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:02.733401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34105 (local address 127.10.30.126:46651)
0812 21:03:02.733455 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:02.733458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:02.733613 (+ 155us) server_negotiation.cc:407] Connection header received
0812 21:03:02.733699 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:02.733700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:02.733711 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:02.733763 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:02.734420 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:02.734987 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:02.735854 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:02.736127 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:02.736214 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:02.737772 (+ 1558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:02.737774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:02.737775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:02.737784 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:02.739608 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:02.740009 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:02.740010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:02.740010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:02.740082 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:02.740318 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:02.740319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:02.740320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:02.740455 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:02.740596 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:02.740712 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 21:03:02.740785 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 21:03:02.756553 14893 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:02.757537 14893 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:02.762236 14893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8babe114ad9843ae82612cbf9d085efa: Generated new TSK 0
I20260812 21:03:02.762516 14893 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:03:02.766779 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14772
W20260812 21:03:02.791972 14750 connection.cc:535] client connection to 127.10.30.126:46651 recv error: Network error: failed to read from TLS socket (remote: 127.10.30.126:46651): Connection reset by peer (error 104)
2026-08-12T21:03:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1790 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:03:02 dist-test-slave-h3ft krb5kdc[14927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:03:02 dist-test-slave-h3ft krb5kdc[14927](info): set up 2 sockets
Aug 12 21:03:02 dist-test-slave-h3ft krb5kdc[14927](info): commencing operation
krb5kdc: starting...
W20260812 21:03:04.145500 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.339s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:04 dist-test-slave-h3ft krb5kdc[14927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:03:04.299185 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44123
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:44123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:04.395748 14944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:04.396163 14944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:04.396209 14944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:04.397521 14944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:04.397603 14944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:04.397629 14944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:04.397650 14944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:04.397681 14944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:04.399389 14944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:44123
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:04.399749 14944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:04.400035 14944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:04.405827 14953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:04.405827 14951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:04.405932 14955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:04.406286 14944 server_base.cc:1034] running on GCE node
I20260812 21:03:04.406646 14944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:04.407083 14944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:04.408274 14944 hybrid_clock.cc:648] HybridClock initialized: now 1786568584408251 us; error 46 us; skew 500 ppm
Aug 12 21:03:04 dist-test-slave-h3ft krb5kdc[14927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568584, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:04.411577 14944 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:03:04.412154 14944 webserver.cc:460] Webserver started at http://127.10.30.126:34203/ using document root <none> and password file <none>
I20260812 21:03:04.412453 14944 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:04.412528 14944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:04.412711 14944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:04.414029 14944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514"
format_stamp: "Formatted at 2026-08-12 21:03:04 on dist-test-slave-h3ft"
server_key: "91521f85982ab497bfeea4b9afe3e30a"
server_key_iv: "a86196b5e2412bb0ec29dd61784a2d15"
server_key_version: "encryptionkey@0"
I20260812 21:03:04.414479 14944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514"
format_stamp: "Formatted at 2026-08-12 21:03:04 on dist-test-slave-h3ft"
server_key: "91521f85982ab497bfeea4b9afe3e30a"
server_key_iv: "a86196b5e2412bb0ec29dd61784a2d15"
server_key_version: "encryptionkey@0"
I20260812 21:03:04.416270 14944 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 21:03:04.417212 14966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:04.417405 14944 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 21:03:04.417526 14944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514"
format_stamp: "Formatted at 2026-08-12 21:03:04 on dist-test-slave-h3ft"
server_key: "91521f85982ab497bfeea4b9afe3e30a"
server_key_iv: "a86196b5e2412bb0ec29dd61784a2d15"
server_key_version: "encryptionkey@0"
I20260812 21:03:04.417629 14944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:04.434605 14944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:04.437381 14944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:04.437602 14944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:04.442813 14944 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:44123
I20260812 21:03:04.442888 15063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:44123 every 8 connection(s)
I20260812 21:03:04.443348 14944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:04.444468 15064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:04.447080 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 14944
I20260812 21:03:04.447263 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:04.447511 10361 external_mini_cluster.cc:1428] Setting key bb7835afb2009ebd95c48e9385c9c920
I20260812 21:03:04.447530 15064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514: Bootstrap starting.
I20260812 21:03:04.448423 15064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:04.448824 15064 log.cc:824] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:04.449649 15064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514: No bootstrap required, opened a new log
I20260812 21:03:04.451830 15064 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44123 } }
I20260812 21:03:04.452033 15064 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:03:04.452105 15064 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca21f0aa73f40ed85bbb2e2aaf2e514, State: Initialized, Role: FOLLOWER
I20260812 21:03:04.452303 15064 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44123 } }
I20260812 21:03:04.452418 15064 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:03:04.452481 15064 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:03:04.452540 15064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:04.453256 15064 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44123 } }
I20260812 21:03:04.453401 15064 leader_election.cc:302] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ca21f0aa73f40ed85bbb2e2aaf2e514; no voters:
I20260812 21:03:04.453655 15064 leader_election.cc:288] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:03:04.453683 15070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:04.453869 15070 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [term 1 LEADER]: Becoming Leader. State: Replica: 7ca21f0aa73f40ed85bbb2e2aaf2e514, State: Running, Role: LEADER
I20260812 21:03:04.454010 15068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:04.448190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60521 (local address 127.10.30.126:44123)
0812 21:03:04.448428 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:04.448437 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:04.448466 (+ 29us) server_negotiation.cc:407] Connection header received
0812 21:03:04.449067 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:04.449075 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:04.449132 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:04.449306 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:04.449579 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:04.450578 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:04.451543 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:04.451995 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:04.452132 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:04.453078 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:04.453083 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:04.453084 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:04.453316 (+ 232us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:04.453356 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:04.453398 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:04.453488 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:04.453679 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 21:03:04.453713 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":96,"threads_started":1}
I20260812 21:03:04.454042 15064 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:04.454017 15070 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44123 } }
I20260812 21:03:04.454665 15070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ca21f0aa73f40ed85bbb2e2aaf2e514. Latest consensus state: current_term: 1 leader_uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44123 } } }
I20260812 21:03:04.454782 15070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:04.455220 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:04.455120 15071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca21f0aa73f40ed85bbb2e2aaf2e514" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44123 } } }
I20260812 21:03:04.455328 15071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514 [sys.catalog]: This master's current role is: LEADER
W20260812 21:03:04.456312 15100 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:03:04.456391 15100 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:03:04.456501 15085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:04.456755 15085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:03:04.459041 15085 catalog_manager.cc:1347] Generated new cluster ID: 80afa4fa4b384c17a1531c1d8bb56f1c
I20260812 21:03:04.459097 15085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:03:04.460862 15068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:04.457162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50129 (local address 127.10.30.126:44123)
0812 21:03:04.457202 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:04.457204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:04.457281 (+ 77us) server_negotiation.cc:407] Connection header received
0812 21:03:04.457358 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:04.457358 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:04.457366 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:04.457414 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:04.457597 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:04.458251 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:04.459329 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:04.459635 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:04.459708 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:04.460579 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:04.460581 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:04.460581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:04.460586 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:04.460604 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:04.460609 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:04.460670 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:04.460771 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 21:03:04.460783 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 21:03:04.470063 15085 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:04.470913 15085 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:04.490648 15085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ca21f0aa73f40ed85bbb2e2aaf2e514: Generated new TSK 0
I20260812 21:03:04.490963 15085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:03:04.502912 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 14944
W20260812 21:03:04.535943 14920 connection.cc:535] client connection to 127.10.30.126:44123 recv error: Network error: failed to read from TLS socket (remote: 127.10.30.126:44123): Connection reset by peer (error 104)
2026-08-12T21:03:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1743 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:03:04 dist-test-slave-h3ft krb5kdc[15117](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:03:04 dist-test-slave-h3ft krb5kdc[15117](info): set up 2 sockets
Aug 12 21:03:04 dist-test-slave-h3ft krb5kdc[15117](info): commencing operation
krb5kdc: starting...
W20260812 21:03:05.899812 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.349s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:06 dist-test-slave-h3ft krb5kdc[15117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:03:06.050895 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35297
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:35297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:06.150961 15140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:06.151363 15140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:06.151410 15140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:06.152820 15140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:06.152904 15140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:06.152937 15140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:06.152969 15140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:06.153002 15140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:06.154767 15140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:35297
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:06.155171 15140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:06.155498 15140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:06.161432 15149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:06.161404 15153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:06.161463 15140 server_base.cc:1034] running on GCE node
W20260812 21:03:06.161401 15148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:06.162074 15140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:06.162469 15140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:06.163669 15140 hybrid_clock.cc:648] HybridClock initialized: now 1786568586163655 us; error 52 us; skew 500 ppm
Aug 12 21:03:06 dist-test-slave-h3ft krb5kdc[15117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568586, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:06.172129 15140 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:03:06.172734 15140 webserver.cc:460] Webserver started at http://127.10.30.126:34255/ using document root <none> and password file <none>
I20260812 21:03:06.173007 15140 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:06.173084 15140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:06.173264 15140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:06.174556 15140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "b8aa8f8d607945a48deac1473d32b94d"
format_stamp: "Formatted at 2026-08-12 21:03:06 on dist-test-slave-h3ft"
server_key: "4465917b7b09805b560f919a9784ae96"
server_key_iv: "341ac074b836d5b13bc6ca01354cbef2"
server_key_version: "encryptionkey@0"
I20260812 21:03:06.174989 15140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "b8aa8f8d607945a48deac1473d32b94d"
format_stamp: "Formatted at 2026-08-12 21:03:06 on dist-test-slave-h3ft"
server_key: "4465917b7b09805b560f919a9784ae96"
server_key_iv: "341ac074b836d5b13bc6ca01354cbef2"
server_key_version: "encryptionkey@0"
I20260812 21:03:06.176635 15140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:03:06.177618 15163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:06.177922 15140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:03:06.178054 15140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "b8aa8f8d607945a48deac1473d32b94d"
format_stamp: "Formatted at 2026-08-12 21:03:06 on dist-test-slave-h3ft"
server_key: "4465917b7b09805b560f919a9784ae96"
server_key_iv: "341ac074b836d5b13bc6ca01354cbef2"
server_key_version: "encryptionkey@0"
I20260812 21:03:06.178143 15140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:06.182003 15140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:06.184428 15140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:06.184626 15140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:06.189674 15140 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:35297
I20260812 21:03:06.189713 15250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:35297 every 8 connection(s)
I20260812 21:03:06.190125 15140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:06.191473 15251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:06.194218 15251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d: Bootstrap starting.
I20260812 21:03:06.194921 15251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:06.195307 15251 log.cc:824] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:06.196161 15251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d: No bootstrap required, opened a new log
I20260812 21:03:06.198015 15251 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8aa8f8d607945a48deac1473d32b94d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35297 } }
I20260812 21:03:06.198201 15251 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:03:06.198228 15251 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8aa8f8d607945a48deac1473d32b94d, State: Initialized, Role: FOLLOWER
I20260812 21:03:06.198414 15251 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8aa8f8d607945a48deac1473d32b94d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35297 } }
I20260812 21:03:06.198510 15251 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:03:06.198539 15251 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:03:06.198575 15251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:06.199579 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15140
I20260812 21:03:06.199615 15251 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8aa8f8d607945a48deac1473d32b94d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35297 } }
I20260812 21:03:06.199750 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:06.199741 15251 leader_election.cc:302] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8aa8f8d607945a48deac1473d32b94d; no voters:
I20260812 21:03:06.199950 15251 leader_election.cc:288] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:03:06.200019 15258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:06.200054 10361 external_mini_cluster.cc:1428] Setting key 6e4fbb515123aa717c25bbb0bdae84bc
I20260812 21:03:06.200207 15258 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [term 1 LEADER]: Becoming Leader. State: Replica: b8aa8f8d607945a48deac1473d32b94d, State: Running, Role: LEADER
I20260812 21:03:06.200292 15251 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:06.200353 15258 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8aa8f8d607945a48deac1473d32b94d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35297 } }
I20260812 21:03:06.200891 15260 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8aa8f8d607945a48deac1473d32b94d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8aa8f8d607945a48deac1473d32b94d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35297 } } }
I20260812 21:03:06.201002 15260 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:06.201031 15263 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8aa8f8d607945a48deac1473d32b94d. Latest consensus state: current_term: 1 leader_uuid: "b8aa8f8d607945a48deac1473d32b94d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8aa8f8d607945a48deac1473d32b94d" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35297 } } }
I20260812 21:03:06.201088 15263 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:06.201399 15277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:06.202332 15277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:03:06.203166 15268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:06.200750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44553 (local address 127.10.30.126:35297)
0812 21:03:06.200990 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:06.201001 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:06.201048 (+ 47us) server_negotiation.cc:407] Connection header received
0812 21:03:06.201210 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:06.201219 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:06.201261 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:06.201929 (+ 668us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:06.202570 (+ 641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:06.202574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:06.202574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:06.202579 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:06.202630 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:06.202648 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:06.202783 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:06.202873 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 21:03:06.202923 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":85,"threads_started":1}
I20260812 21:03:06.204380 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:06.204427 15277 catalog_manager.cc:1347] Generated new cluster ID: 1eb6b17ce5004747a7c4fd7d5bedc151
I20260812 21:03:06.204474 15277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:03:06.207412 15268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:06.206092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49041 (local address 127.10.30.126:35297)
0812 21:03:06.206134 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:06.206136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:06.206300 (+ 164us) server_negotiation.cc:407] Connection header received
0812 21:03:06.206379 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:06.206379 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:06.206386 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:06.206430 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:06.207132 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:06.207134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:06.207134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:06.207138 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:06.207156 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:06.207172 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:06.207248 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:06.207309 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 21:03:06.207324 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 21:03:06.220323 15277 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:06.220607 15277 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:06.223580 15277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8aa8f8d607945a48deac1473d32b94d: Generated new TSK 0
I20260812 21:03:06.223826 15277 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:03:06.230353 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15140
2026-08-12T21:03:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1719 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:03:06 dist-test-slave-h3ft krb5kdc[15304](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:03:06 dist-test-slave-h3ft krb5kdc[15304](info): set up 2 sockets
Aug 12 21:03:06 dist-test-slave-h3ft krb5kdc[15304](info): commencing operation
krb5kdc: starting...
W20260812 21:03:07.591878 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:07 dist-test-slave-h3ft krb5kdc[15304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:03:07.756310 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35543
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:37601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:35543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:07.862651 15325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:07.863018 15325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:07.863114 15325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:07.864773 15325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:07.864920 15325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:07.864950 15325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:07.864974 15325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:07.864993 15325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:07.867141 15325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:35543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:35543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:07.867558 15325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:07.867874 15325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:07.874322 15334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:07.874328 15339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:07.874327 15336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:07.874740 15325 server_base.cc:1034] running on GCE node
I20260812 21:03:07.875170 15325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:07.875562 15325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:07.876732 15325 hybrid_clock.cc:648] HybridClock initialized: now 1786568587876712 us; error 47 us; skew 500 ppm
Aug 12 21:03:07 dist-test-slave-h3ft krb5kdc[15304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568587, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:07.880335 15325 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:03:07.880879 15325 webserver.cc:460] Webserver started at http://127.10.30.126:43977/ using document root <none> and password file <none>
I20260812 21:03:07.881132 15325 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:07.881181 15325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:07.881295 15325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:07.882766 15325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "c20e4cb0695a4f62b98cd136aa3913ff"
format_stamp: "Formatted at 2026-08-12 21:03:07 on dist-test-slave-h3ft"
server_key: "c3d9d6050e894015dff59052eb3859a3"
server_key_iv: "e41cb846a84250e6a948e368b7973479"
server_key_version: "encryptionkey@0"
I20260812 21:03:07.883284 15325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "c20e4cb0695a4f62b98cd136aa3913ff"
format_stamp: "Formatted at 2026-08-12 21:03:07 on dist-test-slave-h3ft"
server_key: "c3d9d6050e894015dff59052eb3859a3"
server_key_iv: "e41cb846a84250e6a948e368b7973479"
server_key_version: "encryptionkey@0"
I20260812 21:03:07.885108 15325 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 21:03:07.886124 15348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:07.886416 15325 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:03:07.886564 15325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "c20e4cb0695a4f62b98cd136aa3913ff"
format_stamp: "Formatted at 2026-08-12 21:03:07 on dist-test-slave-h3ft"
server_key: "c3d9d6050e894015dff59052eb3859a3"
server_key_iv: "e41cb846a84250e6a948e368b7973479"
server_key_version: "encryptionkey@0"
I20260812 21:03:07.886658 15325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:07.904685 15325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:07.907712 15325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:07.907994 15325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:07.914758 15325 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:35543
I20260812 21:03:07.914806 15430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:35543 every 8 connection(s)
I20260812 21:03:07.915623 15325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:07.916565 15432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:07.919850 15432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff: Bootstrap starting.
I20260812 21:03:07.920596 15432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:07.920898 15432 log.cc:824] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:07.921907 15432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff: No bootstrap required, opened a new log
I20260812 21:03:07.924324 15432 raft_consensus.cc:348] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20e4cb0695a4f62b98cd136aa3913ff" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35543 } }
I20260812 21:03:07.924542 15432 raft_consensus.cc:374] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:03:07.924571 15432 raft_consensus.cc:729] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20e4cb0695a4f62b98cd136aa3913ff, State: Initialized, Role: FOLLOWER
I20260812 21:03:07.924770 15432 consensus_queue.cc:260] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20e4cb0695a4f62b98cd136aa3913ff" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35543 } }
I20260812 21:03:07.924875 15432 raft_consensus.cc:388] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:03:07.924904 15432 raft_consensus.cc:482] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:03:07.924947 15432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:07.925634 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15325
I20260812 21:03:07.925835 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:07.926079 10361 external_mini_cluster.cc:1428] Setting key e9f3fc2f24a36a3ff5dfba78c1127389
I20260812 21:03:07.926430 15432 raft_consensus.cc:504] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20e4cb0695a4f62b98cd136aa3913ff" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35543 } }
I20260812 21:03:07.926606 15432 leader_election.cc:302] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c20e4cb0695a4f62b98cd136aa3913ff; no voters:
I20260812 21:03:07.926898 15432 leader_election.cc:288] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:03:07.927026 15435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:07.927455 15435 raft_consensus.cc:686] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [term 1 LEADER]: Becoming Leader. State: Replica: c20e4cb0695a4f62b98cd136aa3913ff, State: Running, Role: LEADER
I20260812 21:03:07.927614 15435 consensus_queue.cc:237] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20e4cb0695a4f62b98cd136aa3913ff" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35543 } }
I20260812 21:03:07.928333 15441 sys_catalog.cc:455] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader c20e4cb0695a4f62b98cd136aa3913ff. Latest consensus state: current_term: 1 leader_uuid: "c20e4cb0695a4f62b98cd136aa3913ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20e4cb0695a4f62b98cd136aa3913ff" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35543 } } }
I20260812 21:03:07.928452 15441 sys_catalog.cc:458] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:07.928644 15435 sys_catalog.cc:455] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c20e4cb0695a4f62b98cd136aa3913ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20e4cb0695a4f62b98cd136aa3913ff" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 35543 } } }
I20260812 21:03:07.928715 15435 sys_catalog.cc:458] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:07.928964 15432 sys_catalog.cc:564] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:07.929199 15443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:07.930020 15443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:03:07.933072 15443 catalog_manager.cc:1347] Generated new cluster ID: d1d620bc112a4ac6911de2e56947f133
I20260812 21:03:07.933259 15443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 21:03:07 dist-test-slave-h3ft krb5kdc[15304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:03:07.943861 15443 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:07.944278 15436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:07.926935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48549 (local address 127.10.30.126:35543)
0812 21:03:07.927190 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:07.927231 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:07.927596 (+ 365us) server_negotiation.cc:407] Connection header received
0812 21:03:07.927889 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:07.927900 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:07.927979 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:07.928179 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:07.929581 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:07.931349 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:07.932511 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:07.933073 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:07.933212 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:07.936871 (+ 3659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:07.936879 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:07.936879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:07.936900 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:07.941273 (+ 4373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:07.941921 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:07.941927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:07.941928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:07.942138 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:07.942428 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:07.942429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:07.942430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:07.942872 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:07.943374 (+ 502us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:07.943553 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 21:03:07.943847 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":147,"threads_started":1}
I20260812 21:03:07.944693 15443 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:07.945848 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:07.950809 15443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c20e4cb0695a4f62b98cd136aa3913ff: Generated new TSK 0
I20260812 21:03:07.951155 15443 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:03:07.957234 15436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:07.947820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39315 (local address 127.10.30.126:35543)
0812 21:03:07.947870 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:07.947872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:07.947979 (+ 107us) server_negotiation.cc:407] Connection header received
0812 21:03:07.948051 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:07.948052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:07.948065 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:07.948131 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:07.948989 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:07.949826 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:07.951129 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:07.951456 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:07.951526 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:07.953566 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:07.953568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:07.953569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:07.953578 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:07.955824 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:07.956347 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:07.956348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:07.956348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:07.956433 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:07.956664 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:07.956664 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:07.956665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:07.956804 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:07.956898 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:07.957056 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 21:03:07.957148 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 21:03:07.960867 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15325
2026-08-12T21:03:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1735 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:03:08 dist-test-slave-h3ft krb5kdc[15478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:03:08 dist-test-slave-h3ft krb5kdc[15478](info): set up 2 sockets
Aug 12 21:03:08 dist-test-slave-h3ft krb5kdc[15478](info): commencing operation
krb5kdc: starting...
W20260812 21:03:09.352900 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.347s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:09 dist-test-slave-h3ft krb5kdc[15478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:03:09.511842 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:37701
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:37995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:37701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:09.615808 15497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:09.616084 15497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:09.616114 15497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:09.617451 15497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:09.617506 15497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:09.617522 15497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:09.617535 15497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:09.617547 15497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:09.619333 15497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:37995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:37701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:37701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:09.619678 15497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:09.619982 15497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 21:03:09.626368 15497 server_base.cc:1034] running on GCE node
W20260812 21:03:09.626341 15505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:09.626294 15507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:09.626294 15504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:09.626924 15497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:09.627413 15497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:09.628629 15497 hybrid_clock.cc:648] HybridClock initialized: now 1786568589628620 us; error 44 us; skew 500 ppm
Aug 12 21:03:09 dist-test-slave-h3ft krb5kdc[15478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568589, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:09.632234 15497 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:03:09.632920 15497 webserver.cc:460] Webserver started at http://127.10.30.126:45361/ using document root <none> and password file <none>
I20260812 21:03:09.633251 15497 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:09.633306 15497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:09.633467 15497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:09.634804 15497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "02cc440fd7a5455ab03a53a3a710b322"
format_stamp: "Formatted at 2026-08-12 21:03:09 on dist-test-slave-h3ft"
server_key: "bfba5c944dc701e2f8c30e47c2324701"
server_key_iv: "831b77fd5a9006231a4e41bc8b2b1160"
server_key_version: "encryptionkey@0"
I20260812 21:03:09.635327 15497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "02cc440fd7a5455ab03a53a3a710b322"
format_stamp: "Formatted at 2026-08-12 21:03:09 on dist-test-slave-h3ft"
server_key: "bfba5c944dc701e2f8c30e47c2324701"
server_key_iv: "831b77fd5a9006231a4e41bc8b2b1160"
server_key_version: "encryptionkey@0"
I20260812 21:03:09.637140 15497 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 21:03:09.638285 15519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:09.638616 15497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:03:09.638754 15497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "02cc440fd7a5455ab03a53a3a710b322"
format_stamp: "Formatted at 2026-08-12 21:03:09 on dist-test-slave-h3ft"
server_key: "bfba5c944dc701e2f8c30e47c2324701"
server_key_iv: "831b77fd5a9006231a4e41bc8b2b1160"
server_key_version: "encryptionkey@0"
I20260812 21:03:09.638855 15497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:09.654788 15497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:09.657902 15497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:09.658205 15497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:09.664314 15497 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:37701
I20260812 21:03:09.664376 15600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:37701 every 8 connection(s)
I20260812 21:03:09.664868 15497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:09.666060 15602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:09.669468 15602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322: Bootstrap starting.
I20260812 21:03:09.670068 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15497
I20260812 21:03:09.670188 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:09.670433 15602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:09.670473 10361 external_mini_cluster.cc:1428] Setting key 959076be67ed2bc8d2e9246de8186d2b
I20260812 21:03:09.670925 15602 log.cc:824] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:09.672240 15602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322: No bootstrap required, opened a new log
I20260812 21:03:09.675352 15602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02cc440fd7a5455ab03a53a3a710b322" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37701 } }
I20260812 21:03:09.675571 15602 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:03:09.675619 15602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02cc440fd7a5455ab03a53a3a710b322, State: Initialized, Role: FOLLOWER
I20260812 21:03:09.675783 15602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02cc440fd7a5455ab03a53a3a710b322" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37701 } }
I20260812 21:03:09.675894 15602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:03:09.675933 15602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:03:09.675992 15602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:09.676927 15602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02cc440fd7a5455ab03a53a3a710b322" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37701 } }
I20260812 21:03:09.677096 15602 leader_election.cc:302] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02cc440fd7a5455ab03a53a3a710b322; no voters:
I20260812 21:03:09.677363 15602 leader_election.cc:288] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:03:09.677413 15613 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:09.677645 15613 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [term 1 LEADER]: Becoming Leader. State: Replica: 02cc440fd7a5455ab03a53a3a710b322, State: Running, Role: LEADER
I20260812 21:03:09.677742 15602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:09.677875 15613 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02cc440fd7a5455ab03a53a3a710b322" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37701 } }
I20260812 21:03:09.678316 15613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02cc440fd7a5455ab03a53a3a710b322. Latest consensus state: current_term: 1 leader_uuid: "02cc440fd7a5455ab03a53a3a710b322" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02cc440fd7a5455ab03a53a3a710b322" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37701 } } }
I20260812 21:03:09.678333 15615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02cc440fd7a5455ab03a53a3a710b322" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02cc440fd7a5455ab03a53a3a710b322" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 37701 } } }
I20260812 21:03:09.678421 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:09.671236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44653 (local address 127.10.30.126:37701)
0812 21:03:09.671516 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:09.671527 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:09.671757 (+ 230us) server_negotiation.cc:407] Connection header received
0812 21:03:09.672617 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:09.672628 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:09.672705 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:09.672905 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:09.673108 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:09.674608 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:09.675586 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:09.676235 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:09.676390 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:09.677216 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:09.677222 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:09.677222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:09.677525 (+ 303us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:09.677585 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:09.677603 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:09.677682 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:09.678049 (+ 367us) server_negotiation.cc:299] Negotiation successful
0812 21:03:09.678134 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":140,"threads_started":1}
I20260812 21:03:09.678498 15615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:09.678889 15613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:09.679373 15625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:09.679792 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:09.680137 15625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:03:09.681941 15625 catalog_manager.cc:1347] Generated new cluster ID: d8605b62e1064b46ad899d4e8ed05439
I20260812 21:03:09.681995 15625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:03:09.685969 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:09.681775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45349 (local address 127.10.30.126:37701)
0812 21:03:09.681833 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:09.681837 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:09.682044 (+ 207us) server_negotiation.cc:407] Connection header received
0812 21:03:09.682147 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:09.682148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:09.682163 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:09.682227 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:09.682427 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:09.683238 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:09.684344 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:09.684664 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:09.684730 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:09.685658 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:09.685660 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:09.685660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:09.685666 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:09.685688 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:09.685693 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:09.685747 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:09.685844 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 21:03:09.685873 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 21:03:09.710952 15625 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:09.711921 15625 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:09.718394 15625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02cc440fd7a5455ab03a53a3a710b322: Generated new TSK 0
I20260812 21:03:09.718716 15625 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:03:09.724162 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15497
2026-08-12T21:03:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1764 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:03:09 dist-test-slave-h3ft krb5kdc[15657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:03:09 dist-test-slave-h3ft krb5kdc[15657](info): set up 2 sockets
Aug 12 21:03:09 dist-test-slave-h3ft krb5kdc[15657](info): commencing operation
krb5kdc: starting...
W20260812 21:03:11.127985 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.358s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:11 dist-test-slave-h3ft krb5kdc[15657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:03:11.288026 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44287
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:42201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:44287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:11.384138 15681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:11.384469 15681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:11.384516 15681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:11.385823 15681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:11.385895 15681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:11.385923 15681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:11.385957 15681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:11.385980 15681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:11.387737 15681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:42201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:44287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:44287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:11.388077 15681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:11.388357 15681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:11.394090 15690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:11.394098 15696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:11.394098 15689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:11.394724 15681 server_base.cc:1034] running on GCE node
I20260812 21:03:11.395175 15681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:11.395572 15681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:11.396744 15681 hybrid_clock.cc:648] HybridClock initialized: now 1786568591396703 us; error 67 us; skew 500 ppm
Aug 12 21:03:11 dist-test-slave-h3ft krb5kdc[15657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568591, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:11.403702 15681 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:03:11.404325 15681 webserver.cc:460] Webserver started at http://127.10.30.126:44563/ using document root <none> and password file <none>
I20260812 21:03:11.404626 15681 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:11.404706 15681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:11.404896 15681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:11.406363 15681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f"
format_stamp: "Formatted at 2026-08-12 21:03:11 on dist-test-slave-h3ft"
server_key: "e58d145bd06195449c0335953eb2f660"
server_key_iv: "604219e4a4ac141b59b5f89638aadb96"
server_key_version: "encryptionkey@0"
I20260812 21:03:11.406821 15681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f"
format_stamp: "Formatted at 2026-08-12 21:03:11 on dist-test-slave-h3ft"
server_key: "e58d145bd06195449c0335953eb2f660"
server_key_iv: "604219e4a4ac141b59b5f89638aadb96"
server_key_version: "encryptionkey@0"
I20260812 21:03:11.408591 15681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:03:11.409727 15708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:11.410102 15681 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260812 21:03:11.410254 15681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f"
format_stamp: "Formatted at 2026-08-12 21:03:11 on dist-test-slave-h3ft"
server_key: "e58d145bd06195449c0335953eb2f660"
server_key_iv: "604219e4a4ac141b59b5f89638aadb96"
server_key_version: "encryptionkey@0"
I20260812 21:03:11.410349 15681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:11.414587 15681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:11.417428 15681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:11.417659 15681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:11.423216 15681 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:44287
I20260812 21:03:11.423247 15794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:44287 every 8 connection(s)
I20260812 21:03:11.423722 15681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:11.425055 15795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:11.425774 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15681
I20260812 21:03:11.425963 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:11.426203 10361 external_mini_cluster.cc:1428] Setting key cfa73e71fa4bbf6eb6291fbf1498dc4a
I20260812 21:03:11.429142 15795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f: Bootstrap starting.
I20260812 21:03:11.429769 15798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:11.426993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60671 (local address 127.10.30.126:44287)
0812 21:03:11.427293 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:11.427305 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:11.427346 (+ 41us) server_negotiation.cc:407] Connection header received
0812 21:03:11.428040 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:11.428051 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:11.428091 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:11.428286 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:11.429169 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:11.429174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:11.429174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:11.429179 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:11.429235 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:11.429251 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:11.429344 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:11.429464 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 21:03:11.429539 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":114,"threads_started":1}
I20260812 21:03:11.430137 15795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:11.430543 15795 log.cc:824] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:11.431138 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:11.431584 15795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f: No bootstrap required, opened a new log
I20260812 21:03:11.434752 15798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:11.433211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57821 (local address 127.10.30.126:44287)
0812 21:03:11.433309 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:11.433311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:11.433471 (+ 160us) server_negotiation.cc:407] Connection header received
0812 21:03:11.433574 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:11.433575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:11.433581 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:11.433674 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:11.434497 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:11.434498 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:11.434499 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 21:03:11.434504 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:11.434521 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 21:03:11.434526 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:11.434603 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:11.434656 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 21:03:11.434674 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 21:03:11.434628 15795 raft_consensus.cc:348] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44287 } }
I20260812 21:03:11.434878 15795 raft_consensus.cc:374] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 21:03:11.434934 15795 raft_consensus.cc:729] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559ed627c6fd4bfc93ad44e3f9d75f2f, State: Initialized, Role: FOLLOWER
I20260812 21:03:11.435108 15795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44287 } }
I20260812 21:03:11.435235 15795 raft_consensus.cc:388] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 21:03:11.435287 15795 raft_consensus.cc:482] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 21:03:11.435346 15795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:11.436110 15795 raft_consensus.cc:504] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44287 } }
I20260812 21:03:11.436223 15795 leader_election.cc:302] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 559ed627c6fd4bfc93ad44e3f9d75f2f; no voters:
I20260812 21:03:11.436384 15795 leader_election.cc:288] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 21:03:11.436488 15806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:11.436719 15806 raft_consensus.cc:686] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [term 1 LEADER]: Becoming Leader. State: Replica: 559ed627c6fd4bfc93ad44e3f9d75f2f, State: Running, Role: LEADER
I20260812 21:03:11.436743 15795 sys_catalog.cc:564] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:11.436828 15806 consensus_queue.cc:237] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44287 } }
I20260812 21:03:11.437362 15809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44287 } } }
I20260812 21:03:11.437382 15810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 559ed627c6fd4bfc93ad44e3f9d75f2f. Latest consensus state: current_term: 1 leader_uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559ed627c6fd4bfc93ad44e3f9d75f2f" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 44287 } } }
I20260812 21:03:11.437529 15809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:11.437547 15810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:11.437814 15819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:11.438608 15819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:03:11.440754 15819 catalog_manager.cc:1347] Generated new cluster ID: a8ed8294ceff40e2a5c023083ed07f3c
I20260812 21:03:11.440824 15819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:03:11.463173 15819 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:11.463467 15819 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:11.470944 15819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 559ed627c6fd4bfc93ad44e3f9d75f2f: Generated new TSK 0
I20260812 21:03:11.471333 15819 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 21:03:11.482143 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15681
2026-08-12T21:03:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1751 ms)
[----------] 18 tests from AuthTokenIssuingTest (31548 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:03:11 dist-test-slave-h3ft krb5kdc[15842](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:03:11 dist-test-slave-h3ft krb5kdc[15842](info): set up 2 sockets
Aug 12 21:03:11 dist-test-slave-h3ft krb5kdc[15842](info): commencing operation
krb5kdc: starting...
W20260812 21:03:12.908460 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.386s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:03:13.068215 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:33615
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:33615,127.10.30.125:38031,127.10.30.124:39077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:13.173264 15860 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 21:03:13.173579 15860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:13.173611 15860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:13.173661 15860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:13.174965 15860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:13.175062 15860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:13.175093 15860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:13.175120 15860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:13.175148 15860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:13.176880 15860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:33615,127.10.30.125:38031,127.10.30.124:39077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:33615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:13.177209 15860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:13.177498 15860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:13.183251 15875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:13.183297 15880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:13.183341 15860 server_base.cc:1034] running on GCE node
W20260812 21:03:13.183257 15874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:13.183935 15860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:13.184326 15860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:13.185525 15860 hybrid_clock.cc:648] HybridClock initialized: now 1786568593185497 us; error 45 us; skew 500 ppm
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:13.188968 15860 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:03:13.189575 15860 webserver.cc:460] Webserver started at http://127.10.30.126:37131/ using document root <none> and password file <none>
I20260812 21:03:13.189900 15860 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:13.190042 15860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:13.190231 15860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:13.191642 15860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "c38cea5d52586a78e94fcacc0c2aedac"
server_key_iv: "65f4dad9099dbf532ea94cb3f1f56cd1"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.192077 15860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "c38cea5d52586a78e94fcacc0c2aedac"
server_key_iv: "65f4dad9099dbf532ea94cb3f1f56cd1"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.193764 15860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 21:03:13.194770 15891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:13.195256 15860 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:03:13.195387 15860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "c38cea5d52586a78e94fcacc0c2aedac"
server_key_iv: "65f4dad9099dbf532ea94cb3f1f56cd1"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.195494 15860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:13.215118 15860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:13.218012 15860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:13.218214 15860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:13.223562 15860 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:33615
I20260812 21:03:13.223605 15979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:33615 every 8 connection(s)
I20260812 21:03:13.224116 15860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:13.225353 15980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:13.227069 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15860
I20260812 21:03:13.227226 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:13.227454 10361 external_mini_cluster.cc:1428] Setting key e9a6c07778724052c365e0e62600c786
I20260812 21:03:13.227654 15980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.30.125@KRBTEST.COM; defaulting to no policy
I20260812 21:03:13.240883 15985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.228795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51340 (local address 127.10.30.126:33615)
0812 21:03:13.230141 (+ 1346us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.230148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.230170 (+ 22us) server_negotiation.cc:407] Connection header received
0812 21:03:13.230263 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.230265 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.230283 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.230396 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.231125 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.232032 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.232988 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.233391 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.233549 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.236482 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.236493 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.236494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.236504 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.238807 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.239439 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.239443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.239444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.239545 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.239796 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.239797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.239797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.240175 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.240251 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.240483 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.240626 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":1307,"thread_start_us":98,"threads_started":1}
I20260812 21:03:13.240902 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.228752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33615 (local address 127.0.0.1:51340)
0812 21:03:13.229040 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.229094 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.229970 (+ 876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.230417 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.230420 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.230770 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.230959 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.230964 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.232142 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.232144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.232881 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.232884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.233507 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.233508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.233577 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.234305 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.234317 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.236373 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.238958 (+ 2585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.238967 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.238970 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.239333 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.239617 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.239618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.239618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.239725 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.240251 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.240259 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.240335 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.240426 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.240703 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":113,"thread_start_us":121,"threads_started":1}
I20260812 21:03:13.241866 15980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.125@KRBTEST.COM" created.
I20260812 21:03:13.242470 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.242297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:47948)
0812 21:03:13.242360 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.242426 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 21:03:13.242642 15893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
I20260812 21:03:13.243247 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.243130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:47956)
0812 21:03:13.243184 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.243214 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 21:03:13.243394 15980 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:38031: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab.
Entry for principal kudu/127.10.30.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab.
I20260812 21:03:13.264675 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.125:38031
--webserver_interface=127.10.30.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab
--principal=kudu/127.10.30.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:33615,127.10.30.125:38031,127.10.30.124:39077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:03:13.292698 15980 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } attempt: 1
I20260812 21:03:13.293371 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.293197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:47962)
0812 21:03:13.293277 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.293328 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 21:03:13.293784 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.293675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:47968)
0812 21:03:13.293729 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.293763 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 21:03:13.293875 15980 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:38031: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
I20260812 21:03:13.362115 15980 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } attempt: 2
I20260812 21:03:13.362815 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.362638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:47978)
0812 21:03:13.362719 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.362770 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 21:03:13.363054 15994 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
I20260812 21:03:13.363266 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.363161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:47988)
0812 21:03:13.363211 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.363244 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 21:03:13.363359 15994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:13.363372 15980 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:38031: Network error: Client connection negotiation failed: client connection to 127.10.30.125:38031: connect: Connection refused (error 111)
W20260812 21:03:13.363400 15994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:13.363456 15994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:13.364923 15994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:13.364967 15994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:13.364984 15994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:13.364996 15994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:13.365008 15994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:13.366863 15994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:33615,127.10.30.125:38031,127.10.30.124:39077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab
--principal=kudu/127.10.30.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.125:38031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.30.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:13.367264 15994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:13.367560 15994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:13.373461 16006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:13.373530 16003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:13.373461 16001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:13.374261 15994 server_base.cc:1034] running on GCE node
I20260812 21:03:13.374598 15994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:13.374965 15994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:13.376200 15994 hybrid_clock.cc:648] HybridClock initialized: now 1786568593376187 us; error 30 us; skew 500 ppm
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:13.379324 15994 init.cc:377] Logged in from keytab as kudu/127.10.30.125@KRBTEST.COM (short username kudu)
I20260812 21:03:13.379994 15994 webserver.cc:460] Webserver started at http://127.10.30.125:37891/ using document root <none> and password file <none>
I20260812 21:03:13.380283 15994 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:13.380362 15994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:13.380540 15994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:13.381875 15994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/data/instance:
uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "7f2a92d6b90b12ce4f2b1a5f606b7a98"
server_key_iv: "86d63b683cbee170c20d438b346f344a"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.382383 15994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/wal/instance:
uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "7f2a92d6b90b12ce4f2b1a5f606b7a98"
server_key_iv: "86d63b683cbee170c20d438b346f344a"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.384243 15994 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 21:03:13.385257 16016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:13.385525 15994 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:03:13.385649 15994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/wal
uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "7f2a92d6b90b12ce4f2b1a5f606b7a98"
server_key_iv: "86d63b683cbee170c20d438b346f344a"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.385735 15994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:13.405480 15994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:13.408469 15994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:13.408703 15994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:13.414364 15994 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.125:38031
I20260812 21:03:13.414402 16097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.125:38031 every 8 connection(s)
I20260812 21:03:13.414886 15994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
I20260812 21:03:13.416146 16099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:13.418126 16099 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:13.422879 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 15994
I20260812 21:03:13.423051 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-1/wal/instance
I20260812 21:03:13.423254 10361 external_mini_cluster.cc:1428] Setting key 5500b8fc932138e4650130754a4150b2
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:03:13.428939 15985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.419032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51348 (local address 127.10.30.126:33615)
0812 21:03:13.419131 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.419134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.419386 (+ 252us) server_negotiation.cc:407] Connection header received
0812 21:03:13.419964 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.419965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.419983 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.420054 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.420760 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.421304 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.422426 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.422704 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.422797 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.425753 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.425755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.425756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.425765 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.427312 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.427765 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.427767 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.427768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.427839 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.428173 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.428174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.428175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.428321 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.428401 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.428721 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.428824 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 21:03:13.429168 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.418944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33615 (local address 127.0.0.1:51348)
0812 21:03:13.419241 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.419286 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.419859 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.420119 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.420122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.420435 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.420677 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.420681 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.421439 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.421441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.422319 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.422322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.422830 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.422832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.422992 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.423767 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.423776 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.425632 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.427403 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.427412 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.427415 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.427677 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.427923 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.427923 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.427924 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.428077 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.428404 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.428413 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.428574 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.428688 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.428873 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":191,"threads_started":1}
I20260812 21:03:13.430083 16099 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.30.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.124@KRBTEST.COM" created.
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
I20260812 21:03:13.443432 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.430492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:48002)
0812 21:03:13.430577 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.430590 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.430653 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.431210 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.431211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.431411 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.431473 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.431475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.432459 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.432460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.432998 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.432999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.433528 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.433529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.433603 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.434184 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.434189 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.439198 (+ 5009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.441798 (+ 2600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.441801 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.441801 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.442066 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.442348 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.442349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.442349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.442431 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.442802 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.442803 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.442913 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.443005 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.443197 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 21:03:13.443509 16104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.430661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48002 (local address 127.10.30.125:38031)
0812 21:03:13.430959 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.430964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.430995 (+ 31us) server_negotiation.cc:407] Connection header received
0812 21:03:13.431076 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.431078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.431092 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.431208 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.431565 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.432353 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.433097 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.433436 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.433530 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.439337 (+ 5807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.439359 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.439360 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.439372 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.441667 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.442184 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.442189 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.442189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.442258 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.442507 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.442507 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.442508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.442705 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.442833 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.443074 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.443298 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":104,"server-negotiator.queue_time_us":261,"thread_start_us":147,"threads_started":1}
I20260812 21:03:13.444499 16099 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:13.445021 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.444828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41166)
0812 21:03:13.444918 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.444985 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 21:03:13.445236 16019 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
I20260812 21:03:13.445819 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.445690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41180)
0812 21:03:13.445758 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.445796 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 21:03:13.445976 16099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:39077: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
I20260812 21:03:13.454540 15980 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab.
Entry for principal kudu/127.10.30.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab.
I20260812 21:03:13.459491 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.124:39077
--webserver_interface=127.10.30.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab
--principal=kudu/127.10.30.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:33615,127.10.30.125:38031,127.10.30.124:39077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
I20260812 21:03:13.463868 16104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.455232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48016 (local address 127.10.30.125:38031)
0812 21:03:13.455300 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.455302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.455312 (+ 10us) server_negotiation.cc:407] Connection header received
0812 21:03:13.455343 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.455344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.455357 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.455422 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.455910 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.456518 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.457373 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.457697 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.457762 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.460441 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.460443 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.460443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.460451 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.462152 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.462631 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.462632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.462633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.462700 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.462975 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.462976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.462976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.463414 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.463487 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.463693 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.463783 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 21:03:13.463949 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.455044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:48016)
0812 21:03:13.455125 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.455139 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.455208 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.455466 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.455468 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.455667 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.455768 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.455769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.456628 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.456629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.457291 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.457294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.457778 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.457779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.457846 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.458442 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.458450 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.460317 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.462259 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.462261 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.462261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.462541 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.462774 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.462775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.462775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.462854 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.463501 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.463502 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.463573 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.463658 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.463793 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 21:03:13.464558 15980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:13.465009 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.464869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41186)
0812 21:03:13.464927 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.464970 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 21:03:13.465390 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.465270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41196)
0812 21:03:13.465323 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.465357 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 21:03:13.465512 15980 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:39077: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
I20260812 21:03:13.495234 16099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } attempt: 1
I20260812 21:03:13.495884 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.495715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41198)
0812 21:03:13.495794 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.495845 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 21:03:13.496325 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.496216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41210)
0812 21:03:13.496269 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.496297 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 21:03:13.496465 16099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:39077: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
I20260812 21:03:13.496667 15980 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } attempt: 1
I20260812 21:03:13.497198 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.497051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41226)
0812 21:03:13.497117 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.497160 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 21:03:13.497648 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.497533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41242)
0812 21:03:13.497586 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.497617 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 21:03:13.497785 15980 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:39077: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
W20260812 21:03:13.560598 16112 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 21:03:13.560895 16112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:13.560915 16112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:13.560940 16112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:13.562222 16112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:13.562278 16112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:13.562292 16112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:13.562304 16112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:13.562317 16112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:13.564050 16112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:33615,127.10.30.125:38031,127.10.30.124:39077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab
--principal=kudu/127.10.30.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.124:39077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.30.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:13.564364 16112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:13.564675 16112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 21:03:13.564640 16099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } attempt: 2
I20260812 21:03:13.565307 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.565114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41248)
0812 21:03:13.565223 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.565271 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 21:03:13.565820 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.565674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41264)
0812 21:03:13.565739 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.565785 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 21:03:13.565979 16099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:39077: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
W20260812 21:03:13.570673 16126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:13.570685 16124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:13.570888 16129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:13.571225 16112 server_base.cc:1034] running on GCE node
I20260812 21:03:13.571528 16112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:13.571890 16112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:13.572944 15980 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } attempt: 2
I20260812 21:03:13.573117 16112 hybrid_clock.cc:648] HybridClock initialized: now 1786568593573084 us; error 68 us; skew 500 ppm
I20260812 21:03:13.573536 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.573374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41280)
0812 21:03:13.573425 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.573477 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 21:03:13.573972 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.573881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41290)
0812 21:03:13.573928 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.573955 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 21:03:13.574108 15980 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:39077: Network error: Client connection negotiation failed: client connection to 127.10.30.124:39077: connect: Connection refused (error 111)
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:13.576645 16112 init.cc:377] Logged in from keytab as kudu/127.10.30.124@KRBTEST.COM (short username kudu)
I20260812 21:03:13.577186 16112 webserver.cc:460] Webserver started at http://127.10.30.124:43529/ using document root <none> and password file <none>
I20260812 21:03:13.577499 16112 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:13.577575 16112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:13.577741 16112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:13.579133 16112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/data/instance:
uuid: "4c8c169cd0b34db299e18fa04929ead0"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "18778522c50b04292d63ad5760b04820"
server_key_iv: "1d5867ad3005b3e1d5562da9c84032d8"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.579599 16112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/wal/instance:
uuid: "4c8c169cd0b34db299e18fa04929ead0"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "18778522c50b04292d63ad5760b04820"
server_key_iv: "1d5867ad3005b3e1d5562da9c84032d8"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.581326 16112 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 21:03:13.582397 16142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:13.582788 16112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 21:03:13.582934 16112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/wal
uuid: "4c8c169cd0b34db299e18fa04929ead0"
format_stamp: "Formatted at 2026-08-12 21:03:13 on dist-test-slave-h3ft"
server_key: "18778522c50b04292d63ad5760b04820"
server_key_iv: "1d5867ad3005b3e1d5562da9c84032d8"
server_key_version: "encryptionkey@0"
I20260812 21:03:13.583082 16112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:13.602221 16112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:13.604916 16112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:13.605145 16112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:13.610643 16112 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.124:39077
I20260812 21:03:13.610704 16234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.124:39077 every 8 connection(s)
I20260812 21:03:13.611168 16112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
I20260812 21:03:13.612421 16236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:13.614883 16236 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:13.618875 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 16112
I20260812 21:03:13.619043 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786568275908695-10361-0/minicluster-data/master-2/wal/instance
I20260812 21:03:13.619285 10361 external_mini_cluster.cc:1428] Setting key 325daf08ef212e030749877d4a9a620a
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:03:13.627556 15985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.616267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51360 (local address 127.10.30.126:33615)
0812 21:03:13.616327 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.616329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.616410 (+ 81us) server_negotiation.cc:407] Connection header received
0812 21:03:13.617357 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.617359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.617377 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.617457 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.618493 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.619386 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.620677 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.620981 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.621086 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.624012 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.624013 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.624014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.624032 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.625543 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.626065 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.626067 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.626068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.626149 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.626431 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.626432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.626433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.626619 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.626700 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.627331 (+ 631us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.627436 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 21:03:13.627790 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.615958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:33615 (local address 127.0.0.1:51360)
0812 21:03:13.616233 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.616295 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.617184 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.617621 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.617627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.618097 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.618359 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.618364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.619496 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.619497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.620568 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.620571 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.621120 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.621121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.621264 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.621957 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.621967 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.623876 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.625673 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.625682 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.625685 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.625978 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.626228 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.626229 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.626230 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.626361 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.626743 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.626871 (+ 128us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.627124 (+ 253us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.627264 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.627484 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":135,"threads_started":1}
I20260812 21:03:13.628479 16236 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:13.629640 16241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.619816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41304 (local address 127.10.30.124:39077)
0812 21:03:13.620062 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.620068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.620098 (+ 30us) server_negotiation.cc:407] Connection header received
0812 21:03:13.620187 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.620190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.620217 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.620322 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.621100 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.622093 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.623207 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.623611 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.623678 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.626254 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.626263 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.626264 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.626272 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.628295 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.628673 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.628677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.628677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.628750 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.629005 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.629006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.629006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.629162 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.629358 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.629415 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.629508 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":154,"threads_started":1}
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:03:13.637060 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.628819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:38031 (local address 127.0.0.1:48032)
0812 21:03:13.628864 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.628875 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.628907 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.629157 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.629159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.629306 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.629346 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.629348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.630151 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.630152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.630957 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.630960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.631520 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.631521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.631591 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.632184 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.632188 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.633601 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.635738 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.635739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.635740 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.635979 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.636277 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.636278 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.636278 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.636350 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.636704 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.636706 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.636765 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.636856 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.636970 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 21:03:13.637136 16104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.628917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48032 (local address 127.10.30.125:38031)
0812 21:03:13.629005 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.629008 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.629017 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:03:13.629054 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.629056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.629069 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.629140 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.629443 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.630069 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.631113 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.631451 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.631525 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.633710 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.633711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.633711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.633719 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.635590 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.636109 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.636110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.636111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.636186 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.636459 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.636461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.636461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.636623 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.636692 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.636886 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.637026 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 21:03:13.637701 16236 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:13.640120 15985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.631260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51374 (local address 127.10.30.126:33615)
0812 21:03:13.631325 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.631327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.631371 (+ 44us) server_negotiation.cc:407] Connection header received
0812 21:03:13.631447 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.631448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.631464 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.631542 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.632198 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.632725 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.633482 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.633781 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.633838 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.636965 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.636967 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.636967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.636978 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.638760 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.639178 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.639179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.639180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.639252 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.639529 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.639530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.639530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.639670 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.639886 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.639923 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.639998 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
I20260812 21:03:13.645957 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.638078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41308)
0812 21:03:13.638118 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.638129 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.638178 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.638986 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.638987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.639190 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.639242 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.639244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.640129 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.640129 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.640796 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.640799 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.641278 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.641279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.641330 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.641764 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.641769 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.643043 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.644833 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.644834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.644834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.645007 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.645225 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.645226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.645226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.645280 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.645570 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.645571 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.645613 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.645699 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.645810 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 21:03:13.645957 16241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.638120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41308 (local address 127.10.30.124:39077)
0812 21:03:13.638861 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.638863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.638869 (+ 6us) server_negotiation.cc:407] Connection header received
0812 21:03:13.638893 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.638893 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.638904 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.638970 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.639331 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.640038 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.640879 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.641190 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.641279 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.643127 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.643128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.643129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.643136 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.644737 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.645085 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.645087 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.645087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.645149 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.645345 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.645346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.645346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.645486 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.645566 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.645723 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.645854 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":720}
I20260812 21:03:13.648223 16236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0: Bootstrap starting.
I20260812 21:03:13.648851 16104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.641036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48034 (local address 127.10.30.125:38031)
0812 21:03:13.641106 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.641108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.641119 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:03:13.641143 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.641144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.641173 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.641240 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.641784 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.642265 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.643049 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.643376 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.643476 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.645807 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.645808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.645809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.645818 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.647524 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.647912 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.647913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.647913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.647979 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.648201 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.648202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.648203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.648383 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.648612 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.648653 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.648741 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 21:03:13.649493 16236 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:13.649890 16236 log.cc:824] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:13.650748 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:13.650985 16236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0: No bootstrap required, opened a new log
I20260812 21:03:13.652933 16236 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } }
I20260812 21:03:13.652204 15938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51374
I20260812 21:03:13.653110 16236 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c8c169cd0b34db299e18fa04929ead0, State: Initialized, Role: FOLLOWER
I20260812 21:03:13.653218 16236 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } }
I20260812 21:03:13.653599 16236 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:13.653568 16243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.653682 16243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 21:03:13.655889 16255 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:03:13.655974 16255 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:03:13.657116 16099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } attempt: 3
I20260812 21:03:13.656301 16112 master_runner.cc:186] Error getting master registration for 127.10.30.126:33615: OK, instance_id { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" instance_seqno: 1786568593222044 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 21:03:13.659974 16112 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:03:13.666893 16241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.657559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41320 (local address 127.10.30.124:39077)
0812 21:03:13.657632 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.657635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.657657 (+ 22us) server_negotiation.cc:407] Connection header received
0812 21:03:13.657763 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.657765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.657780 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.657866 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.658329 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.659120 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.660203 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.660554 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.660634 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.663452 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.663455 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.663455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.663465 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.665378 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.665860 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.665861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.665862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.665931 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.666167 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.666167 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.666168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.666397 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.666467 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.666675 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.666773 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 21:03:13.666898 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.657486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41320)
0812 21:03:13.657568 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.657583 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.657633 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.657918 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.657920 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.658153 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.658223 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.658227 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.659231 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.659232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.660110 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.660114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.660640 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.660641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.660708 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.661344 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.661350 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.663330 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.665491 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.665492 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.665493 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.665776 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.666012 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.666013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.666014 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.666095 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.666475 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.666477 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.666553 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.666639 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.666779 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 21:03:13.670066 16099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb: Bootstrap starting.
I20260812 21:03:13.671223 16099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:13.671607 16099 log.cc:824] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:13.672729 16099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb: No bootstrap required, opened a new log
I20260812 21:03:13.673259 15980 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } attempt: 3
I20260812 21:03:13.675465 16099 raft_consensus.cc:348] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } }
I20260812 21:03:13.675654 16099 raft_consensus.cc:729] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de9e1d64b5c74bd2b8703115ec2ea4cb, State: Initialized, Role: FOLLOWER
I20260812 21:03:13.675756 16099 consensus_queue.cc:260] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } }
I20260812 21:03:13.676187 16099 sys_catalog.cc:564] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:13.676194 16259 sys_catalog.cc:455] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.676460 16259 sys_catalog.cc:458] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [sys.catalog]: This master's current role is: FOLLOWER
W20260812 21:03:13.678642 16272 catalog_manager.cc:1558] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:03:13.678705 16272 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 21:03:13 dist-test-slave-h3ft krb5kdc[15842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568593, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:03:13.678969 15994 master_runner.cc:186] Error getting master registration for 127.10.30.126:33615: OK, instance_id { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" instance_seqno: 1786568593222044 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 21:03:13.682329 15994 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 21:03:13.682632 16241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.673844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41330 (local address 127.10.30.124:39077)
0812 21:03:13.673916 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.673918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.673940 (+ 22us) server_negotiation.cc:407] Connection header received
0812 21:03:13.673976 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.673977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.673988 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.674053 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.674449 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.674964 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.676115 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.676447 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.676532 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.679469 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.679471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.679471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.679479 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.681325 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.681714 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.681716 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.681717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.681787 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.682012 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.682013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.682013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.682179 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.682241 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.682437 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.682525 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 21:03:13.682632 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.673749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:39077 (local address 127.0.0.1:41330)
0812 21:03:13.673823 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:13.673837 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:13.673895 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:13.674061 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:13.674062 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:13.674289 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:13.674361 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.674364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.675144 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.675147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.676007 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:13.676010 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.676772 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.676774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:13.676853 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.677512 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:13.677520 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:13.679361 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:13.681416 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.681418 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.681419 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.681622 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.681864 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:13.681865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:13.681866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:13.681935 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:13.682230 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:13.682231 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:13.682304 (+ 73us) client_negotiation.cc:769] Sending connection context
0812 21:03:13.682384 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 21:03:13.682519 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 21:03:13.684434 15980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7: Bootstrap starting.
I20260812 21:03:13.685292 15980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:13.685724 15980 log.cc:824] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:13.686657 15980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7: No bootstrap required, opened a new log
I20260812 21:03:13.688437 15980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } }
I20260812 21:03:13.688621 15980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf6d7ffc2d845ffaa098a18b1521aa7, State: Initialized, Role: FOLLOWER
I20260812 21:03:13.688747 15980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } }
I20260812 21:03:13.689077 16279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.689167 15980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:13.689214 15938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 21:03:13.689334 15938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:13.690495 15938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } }
I20260812 21:03:13.691358 16056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb"
I20260812 21:03:13.691551 16056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:13.692780 16056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf6d7ffc2d845ffaa098a18b1521aa7 in term 1.
I20260812 21:03:13.693159 15893 leader_election.cc:302] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf6d7ffc2d845ffaa098a18b1521aa7, de9e1d64b5c74bd2b8703115ec2ea4cb; no voters:
I20260812 21:03:13.693557 16302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:13.693815 16302 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf6d7ffc2d845ffaa098a18b1521aa7, State: Running, Role: LEADER
I20260812 21:03:13.694008 16302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } }
I20260812 21:03:13.694088 16193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4c8c169cd0b34db299e18fa04929ead0"
I20260812 21:03:13.694286 16193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:13.694725 16302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cf6d7ffc2d845ffaa098a18b1521aa7. Latest consensus state: current_term: 1 leader_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.694900 16302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:13.695585 16193 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf6d7ffc2d845ffaa098a18b1521aa7 in term 1.
I20260812 21:03:13.696300 15938 leader_election.cc:288] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [CANDIDATE]: Term 1 election: Requested vote from peers de9e1d64b5c74bd2b8703115ec2ea4cb (127.10.30.125:38031), 4c8c169cd0b34db299e18fa04929ead0 (127.10.30.124:39077)
I20260812 21:03:13.689236 16279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 21:03:13.692081 16298 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:03:13.699321 16298 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:03:13.699379 16310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:13.699688 16310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:03:13.709365 15985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.697780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51390 (local address 127.10.30.126:33615)
0812 21:03:13.697831 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.697834 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.698560 (+ 726us) server_negotiation.cc:407] Connection header received
0812 21:03:13.698701 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.698702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.698715 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.698748 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.700196 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.701000 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.702127 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.702433 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.702484 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.704513 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.704515 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.704516 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.704524 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.706458 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.706888 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.706889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.706890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.706953 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.707246 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.707247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.707247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.707863 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.707952 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.709155 (+ 1203us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.709250 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 21:03:13.713110 16104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.700858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48042 (local address 127.10.30.125:38031)
0812 21:03:13.700903 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.700904 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.702252 (+ 1348us) server_negotiation.cc:407] Connection header received
0812 21:03:13.702368 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.702369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.702382 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.702412 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.705054 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.705798 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.707567 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.707886 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.707933 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.709449 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.709450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.709451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.709460 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.711663 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.712095 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.712096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.712097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.712166 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.712380 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.712381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.712381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.712529 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.712659 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.712893 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.712992 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 21:03:13.714087 16241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:13.698190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41340 (local address 127.10.30.124:39077)
0812 21:03:13.698239 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.698242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.701166 (+ 2924us) server_negotiation.cc:407] Connection header received
0812 21:03:13.701270 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.701271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.701284 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.701314 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.703233 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.703988 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.706778 (+ 2790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:13.707130 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:13.707176 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:13.710629 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:13.710630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:13.710631 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:13.710641 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:13.712400 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.712828 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.712829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.712829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.712896 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:13.713100 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:13.713101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:13.713102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:13.713246 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:13.713319 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:13.713870 (+ 551us) server_negotiation.cc:299] Negotiation successful
0812 21:03:13.713964 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 21:03:13.716327 16193 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [term 1 FOLLOWER]: Refusing update from remote peer 4cf6d7ffc2d845ffaa098a18b1521aa7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:03:13.716327 16056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [term 1 FOLLOWER]: Refusing update from remote peer 4cf6d7ffc2d845ffaa098a18b1521aa7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:03:13.716753 16279 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:03:13.716974 16302 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:03:13.718648 16259 sys_catalog.cc:455] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cf6d7ffc2d845ffaa098a18b1521aa7. Latest consensus state: current_term: 1 leader_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.718648 16243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cf6d7ffc2d845ffaa098a18b1521aa7. Latest consensus state: current_term: 1 leader_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.718765 16243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:13.718765 16259 sys_catalog.cc:458] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [sys.catalog]: This master's current role is: FOLLOWER
W20260812 21:03:13.719151 15898 tablet.cc:2369] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:03:13.720331 16325 mvcc.cc:205] Tried to move back new op lower bound from 7317784959858962432 to 7317784959772258304. Current Snapshot: MvccSnapshot[applied={T|T < 7317784959858962432}]
I20260812 21:03:13.720312 16302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.720429 16302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:13.720686 16279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.720768 16279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:13.721163 16243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.721264 16243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:13.721793 16328 mvcc.cc:205] Tried to move back new op lower bound from 7317784959858962432 to 7317784959772258304. Current Snapshot: MvccSnapshot[applied={T|T < 7317784959858962432}]
I20260812 21:03:13.721900 16259 sys_catalog.cc:455] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf6d7ffc2d845ffaa098a18b1521aa7" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 33615 } } peers { permanent_uuid: "de9e1d64b5c74bd2b8703115ec2ea4cb" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 38031 } } peers { permanent_uuid: "4c8c169cd0b34db299e18fa04929ead0" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 39077 } } }
I20260812 21:03:13.722016 16259 sys_catalog.cc:458] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:13.722720 16330 mvcc.cc:205] Tried to move back new op lower bound from 7317784959858962432 to 7317784959772258304. Current Snapshot: MvccSnapshot[applied={T|T < 7317784959858962432}]
I20260812 21:03:13.727744 16310 catalog_manager.cc:1347] Generated new cluster ID: 209f8450e778459db90622961f379dde
I20260812 21:03:13.727834 16310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:03:13.745767 16310 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:13.746896 16310 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:13.759147 16310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4cf6d7ffc2d845ffaa098a18b1521aa7: Generated new TSK 0
I20260812 21:03:13.759662 16310 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 21:03:13.794785 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.792991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48058 (local address 127.10.30.125:38031)
0812 21:03:13.793044 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.793046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.793907 (+ 861us) server_negotiation.cc:407] Connection header received
0812 21:03:13.794045 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.794046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.794060 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.794095 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.794686 (+ 591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48058: BlockingRecv error: recv got EOF from 127.0.0.1:48058 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 21:03:13.795934 15985 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.792722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51396 (local address 127.10.30.126:33615)
0812 21:03:13.792780 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.792783 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.795263 (+ 2480us) server_negotiation.cc:407] Connection header received
0812 21:03:13.795374 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.795375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.795398 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.795431 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.795850 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51396: BlockingRecv error: recv got EOF from 127.0.0.1:51396 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260812 21:03:13.796919 16241 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.793597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41354 (local address 127.10.30.124:39077)
0812 21:03:13.793644 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.793646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.796329 (+ 2683us) server_negotiation.cc:407] Connection header received
0812 21:03:13.796450 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.796452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.796467 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.796500 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.796844 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41354: BlockingRecv error: recv got EOF from 127.0.0.1:41354 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 21:03:13.800244 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.799235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48074 (local address 127.10.30.125:38031)
0812 21:03:13.799280 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.799283 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.799589 (+ 306us) server_negotiation.cc:407] Connection header received
0812 21:03:13.799727 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.799729 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.799756 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.799788 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.800178 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48074: BlockingRecv error: recv got EOF from 127.0.0.1:48074 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 21:03:13.803720 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.802803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48084 (local address 127.10.30.125:38031)
0812 21:03:13.802842 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.802844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.803154 (+ 310us) server_negotiation.cc:407] Connection header received
0812 21:03:13.803256 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.803256 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.803270 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.803299 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.803658 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48084: BlockingRecv error: recv got EOF from 127.0.0.1:48084 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 21:03:13.808276 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.807289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48100 (local address 127.10.30.125:38031)
0812 21:03:13.807335 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.807338 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.807634 (+ 296us) server_negotiation.cc:407] Connection header received
0812 21:03:13.807748 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.807749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.807762 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.807793 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.808207 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48100: BlockingRecv error: recv got EOF from 127.0.0.1:48100 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 21:03:13.815333 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.814073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48116 (local address 127.10.30.125:38031)
0812 21:03:13.814128 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.814131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.814476 (+ 345us) server_negotiation.cc:407] Connection header received
0812 21:03:13.814622 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.814624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.814639 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.814675 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.815258 (+ 583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48116: BlockingRecv error: recv got EOF from 127.0.0.1:48116 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 21:03:13.826449 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.825142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48118 (local address 127.10.30.125:38031)
0812 21:03:13.825205 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.825208 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.825610 (+ 402us) server_negotiation.cc:407] Connection header received
0812 21:03:13.825747 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.825749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.825765 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.825801 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.826364 (+ 563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48118: BlockingRecv error: recv got EOF from 127.0.0.1:48118 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 21:03:13.845824 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.844486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48120 (local address 127.10.30.125:38031)
0812 21:03:13.844552 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.844555 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.844982 (+ 427us) server_negotiation.cc:407] Connection header received
0812 21:03:13.845119 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.845121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.845139 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.845175 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.845737 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48120: BlockingRecv error: recv got EOF from 127.0.0.1:48120 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260812 21:03:13.880892 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.879627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48122 (local address 127.10.30.125:38031)
0812 21:03:13.879691 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.879694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.880063 (+ 369us) server_negotiation.cc:407] Connection header received
0812 21:03:13.880224 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.880225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.880241 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.880276 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.880796 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48122: BlockingRecv error: recv got EOF from 127.0.0.1:48122 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 21:03:13.948055 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:13.947202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48132 (local address 127.10.30.125:38031)
0812 21:03:13.947291 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:13.947294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:13.947334 (+ 40us) server_negotiation.cc:407] Connection header received
0812 21:03:13.947434 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:13.947435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:13.947450 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:13.947514 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:13.947956 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48132: BlockingRecv error: recv got EOF from 127.0.0.1:48132 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 21:03:14.078815 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:14.077979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48136 (local address 127.10.30.125:38031)
0812 21:03:14.078105 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:14.078108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:14.078152 (+ 44us) server_negotiation.cc:407] Connection header received
0812 21:03:14.078208 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:14.078210 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:14.078224 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:14.078277 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:14.078706 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48136: BlockingRecv error: recv got EOF from 127.0.0.1:48136 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 21:03:14.337587 16104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:14.336784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48140 (local address 127.10.30.125:38031)
0812 21:03:14.336893 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:14.336895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:14.336938 (+ 43us) server_negotiation.cc:407] Connection header received
0812 21:03:14.336973 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:14.336974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:14.336989 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:14.337055 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:14.337516 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48140: BlockingRecv error: recv got EOF from 127.0.0.1:48140 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 21:03:14.656628 16255 catalog_manager.cc:1259] Loaded cluster ID: 209f8450e778459db90622961f379dde
I20260812 21:03:14.656780 16255 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0: loading cluster ID for follower catalog manager: success
I20260812 21:03:14.657744 16255 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0: acquiring CA information for follower catalog manager: success
I20260812 21:03:14.658192 16255 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4c8c169cd0b34db299e18fa04929ead0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 21:03:14.679441 16272 catalog_manager.cc:1259] Loaded cluster ID: 209f8450e778459db90622961f379dde
I20260812 21:03:14.679566 16272 catalog_manager.cc:1552] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb: loading cluster ID for follower catalog manager: success
I20260812 21:03:14.680469 16272 catalog_manager.cc:1574] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb: acquiring CA information for follower catalog manager: success
I20260812 21:03:14.680765 16272 catalog_manager.cc:1602] T 00000000000000000000000000000000 P de9e1d64b5c74bd2b8703115ec2ea4cb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 21:03:14.855556 16441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:14.851414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.10.30.125:38031)
0812 21:03:14.851618 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:14.851620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:14.851694 (+ 74us) server_negotiation.cc:407] Connection header received
0812 21:03:14.851777 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:14.851779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:14.851864 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:14.851956 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:14.852138 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.852842 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.854093 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.854448 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.854524 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:14.854754 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:14.855105 (+ 351us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:14.855201 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:14.855417 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 21:03:14.855453 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":121,"threads_started":1}
I20260812 21:03:14.861286 16450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:14.858190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41362 (local address 127.10.30.124:39077)
0812 21:03:14.858342 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:14.858344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:14.858356 (+ 12us) server_negotiation.cc:407] Connection header received
0812 21:03:14.858414 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:14.858415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:14.858467 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:14.858559 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:14.858730 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.859441 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.860363 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.860640 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.860720 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:14.860883 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:14.861048 (+ 165us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:14.861124 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:14.861162 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 21:03:14.861188 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260812 21:03:14.866782 16441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:14.863541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48162 (local address 127.10.30.125:38031)
0812 21:03:14.863602 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:14.863604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:14.863744 (+ 140us) server_negotiation.cc:407] Connection header received
0812 21:03:14.863899 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:14.863900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:14.863918 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:14.863982 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:14.864164 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.864986 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.865878 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.866220 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.866306 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:14.866476 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:14.866520 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:14.866586 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:14.866633 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 21:03:14.866665 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 21:03:14.866928 16450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:14.863794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41364 (local address 127.10.30.124:39077)
0812 21:03:14.863840 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:14.863842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:14.864291 (+ 449us) server_negotiation.cc:407] Connection header received
0812 21:03:14.864374 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:14.864375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:14.864389 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:14.864443 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:14.864599 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.865257 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.866038 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.866288 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.866360 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:14.866565 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:14.866609 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:14.866658 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:14.866751 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 21:03:14.866781 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 21:03:14.868311 16465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:14.863629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51410 (local address 127.10.30.126:33615)
0812 21:03:14.863784 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:14.863787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:14.863796 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:03:14.863859 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:14.863860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:14.863939 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:14.864067 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:14.864254 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.864995 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.866910 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:14.867298 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:14.867537 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:14.867918 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:14.868051 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:14.868113 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:14.868190 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 21:03:14.868222 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260812 21:03:14.870980 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15860
I20260812 21:03:14.891636 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 15994
I20260812 21:03:14.916667 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 16112
2026-08-12T21:03:14Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3431 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 21:03:14 dist-test-slave-h3ft krb5kdc[16471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 21:03:14 dist-test-slave-h3ft krb5kdc[16471](info): set up 2 sockets
Aug 12 21:03:14 dist-test-slave-h3ft krb5kdc[16471](info): commencing operation
krb5kdc: starting...
W20260812 21:03:16.291550 10361 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/test-user.keytab.
Aug 12 21:03:16 dist-test-slave-h3ft krb5kdc[16471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T21:03:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T21:03:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.30.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
Entry for principal kudu/127.10.30.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab.
I20260812 21:03:16.452263 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:36181
--webserver_interface=127.10.30.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:36181,127.10.30.125:43853,127.10.30.124:37249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 21:03:16.551954 16495 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 21:03:16.552291 16495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:16.552326 16495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:16.552377 16495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:16.553836 16495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:16.553926 16495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:16.553953 16495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:16.553977 16495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:16.554006 16495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:16.555912 16495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:36181,127.10.30.125:43853,127.10.30.124:37249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.126.keytab
--principal=kudu/127.10.30.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.126:36181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.30.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:16.556272 16495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:16.556581 16495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 21:03:16.563220 16495 server_base.cc:1034] running on GCE node
W20260812 21:03:16.563181 16505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:16.563181 16513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:16.563181 16507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:16.563970 16495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:16.564406 16495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:16.565646 16495 hybrid_clock.cc:648] HybridClock initialized: now 1786568596565619 us; error 52 us; skew 500 ppm
Aug 12 21:03:16 dist-test-slave-h3ft krb5kdc[16471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:16.576211 16495 init.cc:377] Logged in from keytab as kudu/127.10.30.126@KRBTEST.COM (short username kudu)
I20260812 21:03:16.576925 16495 webserver.cc:460] Webserver started at http://127.10.30.126:45843/ using document root <none> and password file <none>
I20260812 21:03:16.577248 16495 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:16.577328 16495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:16.577502 16495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:16.578904 16495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/data/instance:
uuid: "67a37685eab949cf9a7937f8c77a5a07"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "046c31655357d55038aecb40fbb848fd"
server_key_iv: "527cb3855ee8be5539257f7cbf2f8170"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.579442 16495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/wal/instance:
uuid: "67a37685eab949cf9a7937f8c77a5a07"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "046c31655357d55038aecb40fbb848fd"
server_key_iv: "527cb3855ee8be5539257f7cbf2f8170"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.581113 16495 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:03:16.582190 16530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:16.582484 16495 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:03:16.582624 16495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/wal
uuid: "67a37685eab949cf9a7937f8c77a5a07"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "046c31655357d55038aecb40fbb848fd"
server_key_iv: "527cb3855ee8be5539257f7cbf2f8170"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.582716 16495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:16.602443 16495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:16.605406 16495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:16.605639 16495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:16.611352 16495 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.126:36181
I20260812 21:03:16.611400 16609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.126:36181 every 8 connection(s)
I20260812 21:03:16.611891 16495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/data/info.pb
I20260812 21:03:16.613207 16613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:16.615408 16613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:16.621317 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 16495
I20260812 21:03:16.621491 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-0/wal/instance
I20260812 21:03:16.621735 10361 external_mini_cluster.cc:1428] Setting key 2e461b4f797dff7a1284e16ad19262d7
Aug 12 21:03:16 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:03:16.627683 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.616344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36181 (local address 127.0.0.1:53526)
0812 21:03:16.616589 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.616645 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:16.617315 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:16.617617 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:16.617619 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:16.617933 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:16.618124 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:16.618128 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.619380 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.619381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:16.620141 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:16.620144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.620686 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.620688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:16.620753 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:16.621540 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:16.621554 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:16.623341 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:16.625612 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:16.625619 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:16.625621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:16.625850 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:16.626181 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:16.626182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:16.626182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:16.626288 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:16.626852 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:16.626861 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:16.626936 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 21:03:16.627165 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 21:03:16.627479 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":126,"thread_start_us":120,"threads_started":1}
I20260812 21:03:16.627697 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.616425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53526 (local address 127.10.30.126:36181)
0812 21:03:16.616656 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:16.616660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:16.616754 (+ 94us) server_negotiation.cc:407] Connection header received
0812 21:03:16.617478 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:16.617480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:16.617499 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:16.617588 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:16.618225 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.619259 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.620239 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.620577 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.620669 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:16.623449 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:16.623461 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:16.623461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:16.623470 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:16.625460 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:16.625942 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:16.625946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:16.625946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:16.626074 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:16.626366 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:16.626367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:16.626368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:16.626741 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:16.626843 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:16.627215 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 21:03:16.627388 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":123,"threads_started":1}
I20260812 21:03:16.629347 16613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:16.629866 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.629717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45424)
0812 21:03:16.629767 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.629825 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 21:03:16.630040 16534 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
I20260812 21:03:16.630733 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.630624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45430)
0812 21:03:16.630659 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.630704 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260812 21:03:16.631060 16613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:43853: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.10.30.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab.
Entry for principal kudu/127.10.30.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab.
I20260812 21:03:16.660279 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.125:43853
--webserver_interface=127.10.30.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab
--principal=kudu/127.10.30.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:36181,127.10.30.125:43853,127.10.30.124:37249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:03:16.680429 16613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } attempt: 1
I20260812 21:03:16.681196 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.680982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45434)
0812 21:03:16.681078 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.681141 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 21:03:16.681761 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.681641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45438)
0812 21:03:16.681690 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.681725 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 21:03:16.681950 16613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:43853: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
I20260812 21:03:16.750258 16613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } attempt: 2
I20260812 21:03:16.751096 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.750800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45448)
0812 21:03:16.750907 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.750982 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 21:03:16.751698 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.751532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45458)
0812 21:03:16.751614 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.751659 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 21:03:16.751891 16613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.125:43853: Network error: Client connection negotiation failed: client connection to 127.10.30.125:43853: connect: Connection refused (error 111)
W20260812 21:03:16.765260 16625 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 21:03:16.765578 16625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:16.765596 16625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:16.765623 16625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:16.767097 16625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:16.767153 16625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:16.767167 16625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:16.767181 16625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:16.767194 16625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:16.769021 16625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:36181,127.10.30.125:43853,127.10.30.124:37249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.125.keytab
--principal=kudu/127.10.30.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.125:43853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.30.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:16.769435 16625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:16.769752 16625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:16.775870 16631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:16.775870 16630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:16.775940 16633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:16.776548 16625 server_base.cc:1034] running on GCE node
I20260812 21:03:16.776872 16625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:16.777362 16625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:16.778532 16625 hybrid_clock.cc:648] HybridClock initialized: now 1786568596778506 us; error 42 us; skew 500 ppm
Aug 12 21:03:16 dist-test-slave-h3ft krb5kdc[16471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:16.782114 16625 init.cc:377] Logged in from keytab as kudu/127.10.30.125@KRBTEST.COM (short username kudu)
I20260812 21:03:16.782827 16625 webserver.cc:460] Webserver started at http://127.10.30.125:36543/ using document root <none> and password file <none>
I20260812 21:03:16.783205 16625 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:16.783289 16625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:16.783517 16625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:16.784951 16625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/data/instance:
uuid: "74c55ae89eac4246a74a41a63e649ec7"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "4775212c46a89d6a042c037f63eba241"
server_key_iv: "abaf9c84d8387ed8eb51d86b5bca0aeb"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.785413 16625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/wal/instance:
uuid: "74c55ae89eac4246a74a41a63e649ec7"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "4775212c46a89d6a042c037f63eba241"
server_key_iv: "abaf9c84d8387ed8eb51d86b5bca0aeb"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.787365 16625 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 21:03:16.788339 16650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:16.788545 16625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:03:16.788671 16625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/wal
uuid: "74c55ae89eac4246a74a41a63e649ec7"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "4775212c46a89d6a042c037f63eba241"
server_key_iv: "abaf9c84d8387ed8eb51d86b5bca0aeb"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.788762 16625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:16.801851 16625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:16.804986 16625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:16.805222 16625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:16.810876 16625 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.125:43853
I20260812 21:03:16.810921 16741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.125:43853 every 8 connection(s)
I20260812 21:03:16.811424 16625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/data/info.pb
I20260812 21:03:16.812839 16742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:16.814981 16742 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:16.818650 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 16625
I20260812 21:03:16.818766 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-1/wal/instance
I20260812 21:03:16.819068 10361 external_mini_cluster.cc:1428] Setting key 6d5f0b066c82b7402e06295549c1886b
Aug 12 21:03:16 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:03:16.826419 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.816047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53532 (local address 127.10.30.126:36181)
0812 21:03:16.816175 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:16.816178 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:16.816335 (+ 157us) server_negotiation.cc:407] Connection header received
0812 21:03:16.816947 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:16.816948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:16.817010 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:16.817074 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:16.817916 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.818485 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.819777 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.820060 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.820160 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:16.823126 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:16.823129 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:16.823129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:16.823141 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:16.824775 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:16.825281 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:16.825282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:16.825283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:16.825350 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:16.825634 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:16.825635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:16.825636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:16.825786 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:16.825866 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:16.826198 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 21:03:16.826304 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 21:03:16.826661 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.815936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36181 (local address 127.0.0.1:53532)
0812 21:03:16.816182 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.816229 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:16.816839 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:16.817138 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:16.817142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:16.817484 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:16.817731 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:16.817765 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.818607 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.818608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:16.819669 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:16.819673 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.820199 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.820201 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:16.820351 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:16.821162 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:16.821194 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:16.822927 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:16.824893 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:16.824903 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:16.824906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:16.825184 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:16.825426 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:16.825427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:16.825428 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:16.825561 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:16.825870 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:16.825878 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:16.826049 (+ 171us) client_negotiation.cc:769] Sending connection context
0812 21:03:16.826165 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 21:03:16.826358 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":116,"threads_started":1}
I20260812 21:03:16.827407 16742 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.30.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.30.124@KRBTEST.COM" created.
Aug 12 21:03:16 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
I20260812 21:03:16.839478 16750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.827819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45470 (local address 127.10.30.125:43853)
0812 21:03:16.828034 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:16.828040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:16.828088 (+ 48us) server_negotiation.cc:407] Connection header received
0812 21:03:16.828147 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:16.828150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:16.828165 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:16.828243 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:16.828588 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.829338 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.830134 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.830490 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.830585 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:16.834787 (+ 4202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:16.834801 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:16.834801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:16.834811 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:16.837605 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:16.838104 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:16.838111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:16.838112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:16.838194 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:16.838571 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:16.838572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:16.838572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:16.838793 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:16.838886 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:16.839150 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 21:03:16.839340 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":178,"thread_start_us":143,"threads_started":1}
I20260812 21:03:16.839592 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.827780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45470)
0812 21:03:16.828019 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.828031 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:16.828089 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:16.828266 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:16.828273 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:16.828439 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:16.828499 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:16.828501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.829441 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.829442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:16.830044 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:16.830046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.830582 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.830583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:16.830659 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:16.831305 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:16.831310 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:16.834676 (+ 3366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:16.837742 (+ 3066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:16.837743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:16.837744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:16.837989 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:16.838348 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:16.838350 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:16.838350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:16.838452 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:16.838891 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:16.838892 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:16.838960 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 21:03:16.839080 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 21:03:16.839256 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221}
I20260812 21:03:16.840624 16742 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:16.841161 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.840996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:35992)
0812 21:03:16.841064 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.841129 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 21:03:16.841367 16652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
I20260812 21:03:16.842039 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.841901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36004)
0812 21:03:16.841963 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.842006 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 21:03:16.843119 16613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } attempt: 3
Aug 12 21:03:16 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
W20260812 21:03:16.848152 16742 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:37249: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
I20260812 21:03:16.853183 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.843500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45486)
0812 21:03:16.843567 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.843580 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:16.843638 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:16.843782 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:16.843783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:16.844042 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:16.844130 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:16.844133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.844918 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.844920 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:16.845526 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:16.845527 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.845965 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.845966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:16.846074 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:16.846649 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:16.846654 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:16.848795 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:16.851425 (+ 2630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:16.851426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:16.851427 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:16.851842 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:16.852121 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:16.852123 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:16.852124 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:16.852236 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:16.852716 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:16.852717 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:16.852798 (+ 81us) client_negotiation.cc:769] Sending connection context
0812 21:03:16.852892 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 21:03:16.853038 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 21:03:16.853207 16750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.843529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45486 (local address 127.10.30.125:43853)
0812 21:03:16.843572 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:16.843574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:16.843616 (+ 42us) server_negotiation.cc:407] Connection header received
0812 21:03:16.843704 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:16.843705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:16.843718 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:16.843765 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:16.844231 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.844809 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.845622 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:16.845879 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:16.845964 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:16.848951 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:16.848953 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:16.848953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:16.848962 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:16.851288 (+ 2326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:16.851961 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:16.851963 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:16.851963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:16.852048 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:16.852336 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:16.852338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:16.852339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:16.852611 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:16.852708 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:16.852923 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 21:03:16.853047 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 21:03:16.854238 16613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:16.854841 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.854691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36016)
0812 21:03:16.854751 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.854795 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 21:03:16.855378 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.855232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36030)
0812 21:03:16.855281 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.855317 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 21:03:16.855762 16613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:37249: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.30.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab.
Entry for principal kudu/127.10.30.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab.
I20260812 21:03:16.860116 10361 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgHCG3/build/release/bin/kudu
/tmp/dist-test-taskDgHCG3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.124:37249
--webserver_interface=127.10.30.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab
--principal=kudu/127.10.30.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.30.84:44057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.30.126:36181,127.10.30.125:43853,127.10.30.124:37249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 21:03:16.886976 16613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } attempt: 1
I20260812 21:03:16.887693 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.887520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36046)
0812 21:03:16.887599 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.887651 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 21:03:16.888087 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.887978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36054)
0812 21:03:16.888026 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.888066 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 21:03:16.888182 16613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:37249: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
I20260812 21:03:16.897495 16742 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } attempt: 1
I20260812 21:03:16.898183 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.897997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36070)
0812 21:03:16.898081 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.898139 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 21:03:16.898669 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.898538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36082)
0812 21:03:16.898610 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.898643 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 21:03:16.898803 16742 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:37249: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
I20260812 21:03:16.963349 16613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } attempt: 2
I20260812 21:03:16.964166 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.963944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36088)
0812 21:03:16.964063 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.964123 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260812 21:03:16.964680 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.964567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36096)
0812 21:03:16.964621 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.964654 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 21:03:16.964839 16613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:37249: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
W20260812 21:03:16.964781 16754 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 21:03:16.965096 16754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 21:03:16.965116 16754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 21:03:16.965143 16754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 21:03:16.966557 16754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 21:03:16.966598 16754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 21:03:16.966614 16754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 21:03:16.966626 16754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 21:03:16.966639 16754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 21:03:16.967031 16742 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } attempt: 2
I20260812 21:03:16.967515 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.967364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36112)
0812 21:03:16.967438 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.967479 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 21:03:16.967924 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:16.967823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36120)
0812 21:03:16.967875 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:16.967904 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 21:03:16.968027 16742 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.30.124:37249: Network error: Client connection negotiation failed: client connection to 127.10.30.124:37249: connect: Connection refused (error 111)
I20260812 21:03:16.968904 16754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.30.84:44057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.30.126:36181,127.10.30.125:43853,127.10.30.124:37249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/krb5kdc/kudu_127.10.30.124.keytab
--principal=kudu/127.10.30.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.30.124:37249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.30.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 21:03:16.969193 16754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 21:03:16.969437 16754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 21:03:16.976056 16766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:16.976110 16764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 21:03:16.976056 16763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 21:03:16.976400 16754 server_base.cc:1034] running on GCE node
I20260812 21:03:16.976786 16754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 21:03:16.977173 16754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 21:03:16.978343 16754 hybrid_clock.cc:648] HybridClock initialized: now 1786568596978313 us; error 46 us; skew 500 ppm
Aug 12 21:03:16 dist-test-slave-h3ft krb5kdc[16471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 21:03:16.982055 16754 init.cc:377] Logged in from keytab as kudu/127.10.30.124@KRBTEST.COM (short username kudu)
I20260812 21:03:16.982723 16754 webserver.cc:460] Webserver started at http://127.10.30.124:45037/ using document root <none> and password file <none>
I20260812 21:03:16.983134 16754 fs_manager.cc:359] Metadata directory not provided
I20260812 21:03:16.983202 16754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 21:03:16.983419 16754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 21:03:16.984992 16754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/data/instance:
uuid: "0985a3962edf4a5fb415d4f344238a19"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "c966b9dc149feba9be99e9cad2877ee6"
server_key_iv: "3f5c9ce752a83ceb18eac668ad164ffd"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.985510 16754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/wal/instance:
uuid: "0985a3962edf4a5fb415d4f344238a19"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "c966b9dc149feba9be99e9cad2877ee6"
server_key_iv: "3f5c9ce752a83ceb18eac668ad164ffd"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.987761 16754 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260812 21:03:16.988823 16782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 21:03:16.989156 16754 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 21:03:16.989287 16754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/wal
uuid: "0985a3962edf4a5fb415d4f344238a19"
format_stamp: "Formatted at 2026-08-12 21:03:16 on dist-test-slave-h3ft"
server_key: "c966b9dc149feba9be99e9cad2877ee6"
server_key_iv: "3f5c9ce752a83ceb18eac668ad164ffd"
server_key_version: "encryptionkey@0"
I20260812 21:03:16.989392 16754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 21:03:16.998775 16754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 21:03:17.001799 16754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 21:03:17.002017 16754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 21:03:17.007571 16754 rpc_server.cc:307] RPC server started. Bound to: 127.10.30.124:37249
I20260812 21:03:17.007623 16862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.30.124:37249 every 8 connection(s)
I20260812 21:03:17.008124 16754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/data/info.pb
I20260812 21:03:17.008862 10361 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgHCG3/build/release/bin/kudu as pid 16754
I20260812 21:03:17.009056 10361 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgHCG3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786568275908695-10361-0/minicluster-data/master-2/wal/instance
I20260812 21:03:17.009328 10361 external_mini_cluster.cc:1428] Setting key e34c93f63eb5c18394b3c3e0f8ad54cc
I20260812 21:03:17.009714 16864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 21:03:17.012962 16864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 21:03:17 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
Aug 12 21:03:17 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:03:17.023645 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.010078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36132 (local address 127.10.30.124:37249)
0812 21:03:17.010330 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.010342 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.010387 (+ 45us) server_negotiation.cc:407] Connection header received
0812 21:03:17.011333 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.011345 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.011429 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.011634 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.012343 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.013767 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.014737 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.015418 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.015514 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.019027 (+ 3513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.019037 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.019038 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.019046 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.021226 (+ 2180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.021748 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.021752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.021753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.021962 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.022231 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.022232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.022233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.022651 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.022767 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.023165 (+ 398us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.023364 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":104,"threads_started":1}
I20260812 21:03:17.024055 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.013855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.126:36181 (local address 127.0.0.1:53534)
0812 21:03:17.014135 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:17.014177 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:17.014278 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:17.014500 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:17.014504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:17.014945 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:17.015077 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.015079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.015979 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.015980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.016697 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.016699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.017287 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.017288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.017353 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.017951 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:17.017963 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:17.020062 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:17.022602 (+ 2540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.022610 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.022613 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.022980 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.023274 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.023275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.023275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.023354 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.023649 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:17.023658 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:17.023717 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 21:03:17.023811 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 21:03:17.023941 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":174,"threads_started":1}
I20260812 21:03:17.024318 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.013964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53534 (local address 127.10.30.126:36181)
0812 21:03:17.014050 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.014052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.014256 (+ 204us) server_negotiation.cc:407] Connection header received
0812 21:03:17.014386 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.014387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.014402 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.014469 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.015186 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.015827 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.016804 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.017146 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.017228 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.020208 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.020210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.020210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.020219 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.022495 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.023106 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.023108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.023109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.023189 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.023424 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.023426 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.023426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.023567 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.023647 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.023945 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.024064 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 21:03:17.025008 16864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 21:03:17 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
Aug 12 21:03:17 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.126@KRBTEST.COM
I20260812 21:03:17.033687 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.025352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.125:43853 (local address 127.0.0.1:45494)
0812 21:03:17.025405 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:17.025417 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:17.025457 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:17.025614 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:17.025616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:17.025792 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:17.025836 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.025837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.026508 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.026509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.027086 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.027088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.027495 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.027496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.027565 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.028152 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:17.028157 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:17.029628 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:17.032378 (+ 2750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.032379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.032380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.032609 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.032861 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.032862 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.032863 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.032944 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.033317 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:17.033334 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:17.033398 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 21:03:17.033478 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 21:03:17.033598 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 21:03:17.033798 16750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.025438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45494 (local address 127.10.30.125:43853)
0812 21:03:17.025487 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.025489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.025496 (+ 7us) server_negotiation.cc:407] Connection header received
0812 21:03:17.025528 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.025529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.025538 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.025587 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.025928 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.026424 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.027181 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.027418 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.027497 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.029735 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.029737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.029737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.029748 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.032244 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.032691 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.032692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.032692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.032760 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.033022 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.033022 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.033023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.033227 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.033301 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.033568 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.033673 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 21:03:17.034170 16864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
I20260812 21:03:17.034421 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.024771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53548 (local address 127.10.30.126:36181)
0812 21:03:17.024830 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.024832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.024840 (+ 8us) server_negotiation.cc:407] Connection header received
0812 21:03:17.024885 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.024886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.024899 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.024981 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.025712 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.026205 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.026962 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.027236 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.027321 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.030332 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.030334 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.030334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.030354 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.032244 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.033093 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.033094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.033095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.033156 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.033511 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.033513 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.033513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.033686 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.034017 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.034211 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.034313 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 21:03:17 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.124@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
Aug 12 21:03:17 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.30.125@KRBTEST.COM
I20260812 21:03:17.043136 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.034640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36148 (local address 127.10.30.124:37249)
0812 21:03:17.034718 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.034720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.034727 (+ 7us) server_negotiation.cc:407] Connection header received
0812 21:03:17.034745 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.034745 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.034755 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.034877 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.035293 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.035843 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.036563 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.036785 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.036883 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.039364 (+ 2481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.039366 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.039367 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.039376 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.041203 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.041869 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.041871 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.041872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.042005 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.042276 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.042277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.042277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.042468 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.042553 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.042773 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.043051 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":146,"server-negotiator.queue_time_us":51}
I20260812 21:03:17.043136 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.034534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36148)
0812 21:03:17.034583 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:17.034598 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:17.034651 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:17.034879 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:17.034880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:17.035101 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:17.035154 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.035157 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.035940 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.035941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.036472 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.036473 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.036881 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.036882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.036931 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.037430 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:17.037436 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:17.039273 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:17.041321 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.041322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.041322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.041664 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.042118 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.042119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.042120 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.042198 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.042566 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:17.042567 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:17.042617 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 21:03:17.042743 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 21:03:17.042957 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":5}
I20260812 21:03:17.044144 16750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.035287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45502 (local address 127.10.30.125:43853)
0812 21:03:17.035336 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.035338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.035347 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:03:17.035409 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.035410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.035420 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.035475 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.035986 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.036465 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.037190 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.037411 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.037498 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.040570 (+ 3072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.040573 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.040574 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.040584 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.042589 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.042981 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.042982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.042983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.043077 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.043339 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.043340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.043341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.043521 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.043759 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.043949 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.044049 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 21:03:17.045750 16864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19: Bootstrap starting.
I20260812 21:03:17.045970 10361 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 21:03:17.047111 16864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:17.047510 16864 log.cc:824] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:17.047109 16567 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "67a37685eab949cf9a7937f8c77a5a07"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53548
I20260812 21:03:17.048533 16864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19: No bootstrap required, opened a new log
I20260812 21:03:17.050248 16864 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } }
I20260812 21:03:17.050429 16864 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0985a3962edf4a5fb415d4f344238a19, State: Initialized, Role: FOLLOWER
I20260812 21:03:17.050726 16864 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } }
I20260812 21:03:17.051254 16875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.051357 16864 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:17.051376 16875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 21:03:17.053911 16895 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:03:17.054025 16895 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:03:17.054432 16754 master_runner.cc:186] Error getting master registration for 127.10.30.126:36181: OK, instance_id { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" instance_seqno: 1786568596609696 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 21:03:17.058216 16754 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 21:03:17.059170 16742 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } attempt: 3
I20260812 21:03:17.064049 16613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } attempt: 3
Aug 12 21:03:17 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.125@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:03:17.069795 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.059689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36150 (local address 127.10.30.124:37249)
0812 21:03:17.059753 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.059756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.059811 (+ 55us) server_negotiation.cc:407] Connection header received
0812 21:03:17.059896 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.059897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.059910 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.059995 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.060635 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.061402 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.062295 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.062537 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.062632 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.065623 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.065625 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.065626 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.065636 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.068083 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.068654 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.068655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.068656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.068741 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.069003 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.069004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.069004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.069245 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.069348 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.069545 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.069659 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 21:03:17.069795 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.059598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36150)
0812 21:03:17.059747 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:17.059763 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:17.059831 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:17.059999 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:17.060000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:17.060438 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:17.060509 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.060513 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.061559 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.061561 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.062180 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.062183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.062648 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.062650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.062734 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.063428 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:17.063434 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:17.065512 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:17.068214 (+ 2702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.068216 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.068217 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.068546 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.068816 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.068818 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.068818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.068907 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.069340 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:17.069341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:17.069420 (+ 79us) client_negotiation.cc:769] Sending connection context
0812 21:03:17.069513 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 21:03:17.069659 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
Aug 12 21:03:17 dist-test-slave-h3ft krb5kdc[16471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786568596, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.30.126@KRBTEST.COM for kudu/127.10.30.124@KRBTEST.COM
I20260812 21:03:17.072359 16742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7: Bootstrap starting.
I20260812 21:03:17.073588 16742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:17.074064 16742 log.cc:824] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7: Log is configured to *not* fsync() on all Append() calls
I20260812 21:03:17.075302 16742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7: No bootstrap required, opened a new log
I20260812 21:03:17.076414 16617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.064507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.30.124:37249 (local address 127.0.0.1:36154)
0812 21:03:17.064596 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 21:03:17.064613 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 21:03:17.064675 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 21:03:17.065262 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 21:03:17.065265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 21:03:17.065501 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 21:03:17.065592 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.065596 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.067681 (+ 2085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.067683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.068523 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 21:03:17.068528 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.069094 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.069095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 21:03:17.069183 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.069740 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 21:03:17.069748 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 21:03:17.072051 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 21:03:17.074787 (+ 2736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.074790 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.074790 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.075127 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.075474 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 21:03:17.075477 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 21:03:17.075491 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 21:03:17.075588 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 21:03:17.075958 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 21:03:17.075959 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 21:03:17.076030 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 21:03:17.076121 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 21:03:17.076283 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 21:03:17.076436 16900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.064702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36154 (local address 127.10.30.124:37249)
0812 21:03:17.065015 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.065017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.065024 (+ 7us) server_negotiation.cc:407] Connection header received
0812 21:03:17.065050 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.065051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.065062 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.065216 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.065692 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.067537 (+ 1845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.068654 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.069011 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.069087 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.072190 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.072193 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.072193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.072205 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.074641 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.075235 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.075236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.075236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.075312 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.075687 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.075688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.075689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.075872 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.075961 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.076177 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.076288 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":200,"threads_started":1}
I20260812 21:03:17.078495 16742 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } }
I20260812 21:03:17.078714 16742 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74c55ae89eac4246a74a41a63e649ec7, State: Initialized, Role: FOLLOWER
I20260812 21:03:17.078830 16742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } }
I20260812 21:03:17.079396 16742 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:17.079317 16902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.079681 16902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:17.079835 16613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07: Bootstrap starting.
I20260812 21:03:17.081233 16613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07: Neither blocks nor log segments found. Creating new log.
I20260812 21:03:17.081825 16613 log.cc:824] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07: Log is configured to *not* fsync() on all Append() calls
W20260812 21:03:17.082124 16926 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 21:03:17.082185 16926 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 21:03:17.082880 16613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07: No bootstrap required, opened a new log
I20260812 21:03:17.084753 16613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } }
I20260812 21:03:17.084949 16613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67a37685eab949cf9a7937f8c77a5a07, State: Initialized, Role: FOLLOWER
I20260812 21:03:17.085069 16613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } }
I20260812 21:03:17.085536 16567 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 21:03:17.085474 16932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.085659 16567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:17.082588 16625 master_runner.cc:186] Error getting master registration for 127.10.30.126:36181: OK, instance_id { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" instance_seqno: 1786568596609696 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 21:03:17.086891 16625 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 21:03:17.085501 16613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 21:03:17.086977 16567 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } }
I20260812 21:03:17.087409 16567 leader_election.cc:288] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [CANDIDATE]: Term 1 election: Requested vote from peers 74c55ae89eac4246a74a41a63e649ec7 (127.10.30.125:43853), 0985a3962edf4a5fb415d4f344238a19 (127.10.30.124:37249)
I20260812 21:03:17.087829 16696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "67a37685eab949cf9a7937f8c77a5a07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "74c55ae89eac4246a74a41a63e649ec7"
I20260812 21:03:17.088011 16696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:17.089171 16826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "67a37685eab949cf9a7937f8c77a5a07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0985a3962edf4a5fb415d4f344238a19"
I20260812 21:03:17.089279 16696 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67a37685eab949cf9a7937f8c77a5a07 in term 1.
I20260812 21:03:17.089372 16826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 21:03:17.089866 16534 leader_election.cc:302] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67a37685eab949cf9a7937f8c77a5a07, 74c55ae89eac4246a74a41a63e649ec7; no voters:
I20260812 21:03:17.089227 16932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:17.090257 16932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 21:03:17.090351 16932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [term 1 LEADER]: Becoming Leader. State: Replica: 67a37685eab949cf9a7937f8c77a5a07, State: Running, Role: LEADER
I20260812 21:03:17.090466 16932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } }
I20260812 21:03:17.090969 16826 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67a37685eab949cf9a7937f8c77a5a07 in term 1.
I20260812 21:03:17.091995 16954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67a37685eab949cf9a7937f8c77a5a07. Latest consensus state: current_term: 1 leader_uuid: "67a37685eab949cf9a7937f8c77a5a07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.092126 16954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:17.092398 16957 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 21:03:17.094085 16957 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 21:03:17.104624 16750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.091950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45508 (local address 127.10.30.125:43853)
0812 21:03:17.092034 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.092037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.095333 (+ 3296us) server_negotiation.cc:407] Connection header received
0812 21:03:17.095413 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.095414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.095431 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.095491 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.096535 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.097337 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.098503 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.098834 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.098891 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.101052 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.101055 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.101055 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.101065 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.103038 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.103557 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.103559 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.103560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.103635 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.103848 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.103849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.103849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.104021 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.104136 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.104389 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.104499 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 21:03:17.106736 16538 tablet.cc:2369] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 21:03:17.113482 16826 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [term 1 FOLLOWER]: Refusing update from remote peer 67a37685eab949cf9a7937f8c77a5a07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:03:17.113960 16954 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:03:17.115175 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.093376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53552 (local address 127.10.30.126:36181)
0812 21:03:17.093429 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.093432 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.105977 (+ 12545us) server_negotiation.cc:407] Connection header received
0812 21:03:17.106101 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.106103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.106122 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.106156 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.107149 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.108016 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.109112 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.109442 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.109489 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.111351 (+ 1862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.111353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.111354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.111363 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.113265 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.113935 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.113937 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.113937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.114016 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.114417 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.114418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.114418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.114591 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.114702 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.114922 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.115069 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 21:03:17.115967 16875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67a37685eab949cf9a7937f8c77a5a07. Latest consensus state: current_term: 1 leader_uuid: "67a37685eab949cf9a7937f8c77a5a07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.116092 16875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:17.116659 16696 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [term 1 FOLLOWER]: Refusing update from remote peer 67a37685eab949cf9a7937f8c77a5a07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 21:03:17.116989 16954 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 21:03:17.118978 16902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67a37685eab949cf9a7937f8c77a5a07. Latest consensus state: current_term: 1 leader_uuid: "67a37685eab949cf9a7937f8c77a5a07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.119127 16902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:17.123163 16900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:17.093988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36156 (local address 127.10.30.124:37249)
0812 21:03:17.094088 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.094090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.107351 (+ 13261us) server_negotiation.cc:407] Connection header received
0812 21:03:17.107427 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.107429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.107456 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.107532 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.108376 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.109204 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.110312 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:17.110701 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:17.110750 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:17.119296 (+ 8546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 21:03:17.119298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 21:03:17.119298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 21:03:17.119312 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 21:03:17.121479 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.122031 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.122032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.122033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.122101 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 21:03:17.122318 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 21:03:17.122319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 21:03:17.122319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 21:03:17.122527 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 21:03:17.122636 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:17.122873 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 21:03:17.123029 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 21:03:17.128024 16954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "67a37685eab949cf9a7937f8c77a5a07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.128199 16954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:17.128939 16875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "67a37685eab949cf9a7937f8c77a5a07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.129069 16875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:17.129961 16964 mvcc.cc:205] Tried to move back new op lower bound from 7317784973749968896 to 7317784973684297728. Current Snapshot: MvccSnapshot[applied={T|T < 7317784973749968896}]
I20260812 21:03:17.130612 16902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "67a37685eab949cf9a7937f8c77a5a07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.130726 16902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 21:03:17.131137 16932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "67a37685eab949cf9a7937f8c77a5a07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67a37685eab949cf9a7937f8c77a5a07" member_type: VOTER last_known_addr { host: "127.10.30.126" port: 36181 } } peers { permanent_uuid: "74c55ae89eac4246a74a41a63e649ec7" member_type: VOTER last_known_addr { host: "127.10.30.125" port: 43853 } } peers { permanent_uuid: "0985a3962edf4a5fb415d4f344238a19" member_type: VOTER last_known_addr { host: "127.10.30.124" port: 37249 } } }
I20260812 21:03:17.131263 16932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07 [sys.catalog]: This master's current role is: LEADER
I20260812 21:03:17.131493 16968 mvcc.cc:205] Tried to move back new op lower bound from 7317784973749968896 to 7317784973684297728. Current Snapshot: MvccSnapshot[applied={T|T < 7317784973749968896}]
I20260812 21:03:17.139869 16957 catalog_manager.cc:1347] Generated new cluster ID: cb8ab95a45584bb393124767b271255e
I20260812 21:03:17.139990 16957 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 21:03:17.160130 16957 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 21:03:17.162513 16957 catalog_manager.cc:1504] Loading token signing keys...
I20260812 21:03:17.168159 16957 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67a37685eab949cf9a7937f8c77a5a07: Generated new TSK 0
I20260812 21:03:17.168466 16957 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 21:03:17.201253 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.198873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45516 (local address 127.10.30.125:43853)
0812 21:03:17.198944 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.198947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.200285 (+ 1338us) server_negotiation.cc:407] Connection header received
0812 21:03:17.200440 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.200442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.200460 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.200499 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.201147 (+ 648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45516: BlockingRecv error: recv got EOF from 127.0.0.1:45516 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260812 21:03:17.202281 16618 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.199499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53566 (local address 127.10.30.126:36181)
0812 21:03:17.199558 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.199560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.201623 (+ 2063us) server_negotiation.cc:407] Connection header received
0812 21:03:17.201742 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.201744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.201761 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.201797 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.202196 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53566: BlockingRecv error: recv got EOF from 127.0.0.1:53566 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260812 21:03:17.203296 16900 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.199937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36162 (local address 127.10.30.124:37249)
0812 21:03:17.199997 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.200000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.202550 (+ 2550us) server_negotiation.cc:407] Connection header received
0812 21:03:17.202707 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.202709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.202725 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.202766 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.203216 (+ 450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36162: BlockingRecv error: recv got EOF from 127.0.0.1:36162 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260812 21:03:17.206555 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.205510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45520 (local address 127.10.30.125:43853)
0812 21:03:17.205566 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.205568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.205850 (+ 282us) server_negotiation.cc:407] Connection header received
0812 21:03:17.205982 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.205983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.206010 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.206048 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.206486 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45520: BlockingRecv error: recv got EOF from 127.0.0.1:45520 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 21:03:17.210467 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.209308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45530 (local address 127.10.30.125:43853)
0812 21:03:17.209375 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.209377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.209727 (+ 350us) server_negotiation.cc:407] Connection header received
0812 21:03:17.209861 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.209863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.209878 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.209916 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.210387 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45530: BlockingRecv error: recv got EOF from 127.0.0.1:45530 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 21:03:17.215044 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.213944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45532 (local address 127.10.30.125:43853)
0812 21:03:17.213995 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.213997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.214331 (+ 334us) server_negotiation.cc:407] Connection header received
0812 21:03:17.214455 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.214456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.214471 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.214507 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.214941 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45532: BlockingRecv error: recv got EOF from 127.0.0.1:45532 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 21:03:17.222015 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.220720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45548 (local address 127.10.30.125:43853)
0812 21:03:17.220781 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.220784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.221184 (+ 400us) server_negotiation.cc:407] Connection header received
0812 21:03:17.221341 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.221342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.221360 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.221400 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.221929 (+ 529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45548: BlockingRecv error: recv got EOF from 127.0.0.1:45548 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 21:03:17.233385 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.231997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45558 (local address 127.10.30.125:43853)
0812 21:03:17.232066 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.232069 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.232492 (+ 423us) server_negotiation.cc:407] Connection header received
0812 21:03:17.232659 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.232661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.232680 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.232721 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.233283 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45558: BlockingRecv error: recv got EOF from 127.0.0.1:45558 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260812 21:03:17.252686 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.251260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45562 (local address 127.10.30.125:43853)
0812 21:03:17.251325 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.251328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.251780 (+ 452us) server_negotiation.cc:407] Connection header received
0812 21:03:17.251914 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.251916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.251932 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.251969 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.252593 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45562: BlockingRecv error: recv got EOF from 127.0.0.1:45562 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 21:03:17.287824 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.286471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45576 (local address 127.10.30.125:43853)
0812 21:03:17.286537 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.286540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.286938 (+ 398us) server_negotiation.cc:407] Connection header received
0812 21:03:17.287115 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.287116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.287134 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.287188 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.287742 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45576: BlockingRecv error: recv got EOF from 127.0.0.1:45576 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 21:03:17.354816 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.353786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45592 (local address 127.10.30.125:43853)
0812 21:03:17.353901 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.353904 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.354049 (+ 145us) server_negotiation.cc:407] Connection header received
0812 21:03:17.354105 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.354106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.354121 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.354193 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.354698 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45592: BlockingRecv error: recv got EOF from 127.0.0.1:45592 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 21:03:17.485508 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.484558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45594 (local address 127.10.30.125:43853)
0812 21:03:17.484645 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.484647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.484764 (+ 117us) server_negotiation.cc:407] Connection header received
0812 21:03:17.484829 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.484831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.484845 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.484917 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.485385 (+ 468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45594: BlockingRecv error: recv got EOF from 127.0.0.1:45594 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 21:03:17.744241 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 21:03:17.743181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45606 (local address 127.10.30.125:43853)
0812 21:03:17.743278 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:17.743281 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:17.743358 (+ 77us) server_negotiation.cc:407] Connection header received
0812 21:03:17.743517 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:17.743519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:17.743533 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:17.743613 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 21:03:17.744118 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45606: BlockingRecv error: recv got EOF from 127.0.0.1:45606 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 21:03:18.054723 16895 catalog_manager.cc:1259] Loaded cluster ID: cb8ab95a45584bb393124767b271255e
I20260812 21:03:18.054896 16895 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19: loading cluster ID for follower catalog manager: success
I20260812 21:03:18.056070 16895 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19: acquiring CA information for follower catalog manager: success
I20260812 21:03:18.056509 16895 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0985a3962edf4a5fb415d4f344238a19: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 21:03:18.082916 16926 catalog_manager.cc:1259] Loaded cluster ID: cb8ab95a45584bb393124767b271255e
I20260812 21:03:18.083133 16926 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7: loading cluster ID for follower catalog manager: success
I20260812 21:03:18.084641 16926 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7: acquiring CA information for follower catalog manager: success
I20260812 21:03:18.085381 16926 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 74c55ae89eac4246a74a41a63e649ec7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 21:03:18.261096 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:18.257801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45612 (local address 127.10.30.125:43853)
0812 21:03:18.258020 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:18.258023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:18.258039 (+ 16us) server_negotiation.cc:407] Connection header received
0812 21:03:18.258137 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:18.258138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:18.258222 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:18.258323 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:18.258495 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.259106 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.259973 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.260230 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.260307 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:18.260483 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:18.260656 (+ 173us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:18.260750 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:18.260965 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 21:03:18.260994 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":99,"threads_started":1}
I20260812 21:03:18.266919 17093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:18.263960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36172 (local address 127.10.30.124:37249)
0812 21:03:18.264204 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:18.264207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:18.264219 (+ 12us) server_negotiation.cc:407] Connection header received
0812 21:03:18.264278 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:18.264278 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:18.264335 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:18.264441 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:18.264605 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.265161 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.265992 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.266249 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.266325 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:18.266471 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:18.266610 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:18.266681 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:18.266724 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 21:03:18.266749 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":101,"threads_started":1}
I20260812 21:03:18.272838 17093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:18.269594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36180 (local address 127.10.30.124:37249)
0812 21:03:18.269667 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:18.269670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:18.269679 (+ 9us) server_negotiation.cc:407] Connection header received
0812 21:03:18.269782 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:18.269784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:18.269798 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:18.269854 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:18.270073 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.270687 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.271899 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.272211 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.272309 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:18.272484 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:18.272526 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:18.272592 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:18.272694 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 21:03:18.272728 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 21:03:18.273028 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:18.269524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45616 (local address 127.10.30.125:43853)
0812 21:03:18.269598 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:18.269601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:18.269613 (+ 12us) server_negotiation.cc:407] Connection header received
0812 21:03:18.269834 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:18.269835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:18.269849 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:18.269909 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:18.270300 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.271094 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.272075 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.272389 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.272460 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:18.272695 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:18.272741 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:18.272793 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:18.272875 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 21:03:18.272911 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 21:03:18.273523 17108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 21:03:18.269326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53572 (local address 127.10.30.126:36181)
0812 21:03:18.269571 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 21:03:18.269575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 21:03:18.269586 (+ 11us) server_negotiation.cc:407] Connection header received
0812 21:03:18.269650 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 21:03:18.269652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 21:03:18.269759 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 21:03:18.269897 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 21:03:18.270147 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.270991 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.272117 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 21:03:18.272483 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 21:03:18.272553 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 21:03:18.272810 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 21:03:18.272958 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 21:03:18.273357 (+ 399us) server_negotiation.cc:1035] Waiting for connection context
0812 21:03:18.273379 (+ 22us) server_negotiation.cc:299] Negotiation successful
0812 21:03:18.273420 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":125,"threads_started":1}
I20260812 21:03:18.275906 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 16495
I20260812 21:03:18.297694 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 16625
I20260812 21:03:18.328509 10361 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgHCG3/build/release/bin/kudu with pid 16754
2026-08-12T21:03:18Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3414 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6845 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (322429 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST